Floratune
FloraTune is an innovative project dedicated to fostering a harmonious connection between people and the natural world. In a society that often overlooks the significance of our relationship with nature, FloraTune strives to bridge the gap and promote a deeper understanding and appreciation of the natural world.
It endeavors to create an experience that facilitates an immersive and transformative connection between people and nature. By fostering a reciprocal and balanced connection, it envisions a future where humans and the natural world coexist in harmony, working together to ensure the survival and well-being of all living beings on our precious planet.
Team size::
4
Duration:
15 weeks
My role
Research and Conceptualization: Collaborated with team members to conduct initial research and brainstorming sessions, contributing to the development of the project concept for a phygital (physical + digital) product, FloraTune.
Technical Development: Took primary responsibility for sourcing and assembling electronic circuits, playing a pivotal role in the physical functionality of the product.
Visual Presentation: Learned and utilized TouchDesigner software to create compelling visual displays, enhancing the interactive experience of the product.
Exhibition Coordination: Managed the integration of the product with the final exhibition, including coordinating research and setup to ensure a seamless presentation.
Feedback Analysis and Visualization: Processed and visualized questionnaire feedback data to assess user interactions and satisfaction.
Visual Optimization: Led the enhancement of visual effects based on feedback from the product showcase, focusing on improving user engagement and the overall aesthetic appeal.
Conclusion
Through a meticulous design process that included in-depth research, iterative prototyping, and user testing, we brought Floratune to life, delivering an interactive experience that exceeded expectations. We began with extensive user research to understand the ways people connect with nature, followed by concept development that explored how biodata could be sonified to create a harmonious blend of music and plant life.
Our design process involved multiple iterations of prototypes, incorporating user feedback to refine the interface and interaction models, ensuring an intuitive and engaging experience. Rigorous testing allowed us to optimize the system's responsiveness and aesthetics, resulting in a solution that seamlessly integrates nature and technology. This project exemplifies our commitment to crafting thoughtful digital solutions that foster meaningful connections with the environment while offering a captivating, immersive experience for users.
Project Detail
Main Problem
Design plays a vital role in this by shaping our environment and mindset, recognizing nature as an equal partner.
People overlook the importance of connecting with nature and other living beings. Instead, our interactions tend to exploit resources for human gain, causing ecological problems.
To survive and thrive, we must build a balanced relationship with nature, valuing all forms of life.
Target Audience
Urban Dwellers
Individuals living in bustling cities with limited access to nature, seeking to re-establish that connection
Environmental Enthusiasts
People passionate about sustainability, eager to explore innovative ways of creating a deeper connection with nature
Families and Children
Leading younger generations and families to cultivate an early appreciation for the environment and create lasting connections with nature
Concept
Concept Iterations
Iteration 1
PROS: Aesthetically pleasing object for indoor and outdoor use
CONS: Impractical to carry around, plant-like appearance was misleading
Iteration 2
PROS: Integration with nature, same functionality from previous iteration
CONS: Lack of portability, misleading shape that hinders interaction, questionable music-changing option
Iteration 3
Portable, intuitive shape and simplified interaction, ergonomic to hold
Final Concept
Scenarios
Feedbacks and Feedforwards
Prototype
Technology
Structure
Ergonomics
Theoretical Research
Hands-on Experiments
Testing
Exhibition
For the showcase segment of the FloraTune project, we designed an immersive exhibition environment.Two devices will be installed to two different plants, in a dark room where projections of abstract plants will the surrounding the visitors, allowing for a more immersive experience
Immersive Room
Music and Visuals
We utilized Ableton Live to convert digital signals from Arduino into melodies, further enhancing these tunes into pleasing musical compositions. This process allowed us to transform interactions with plants into an auditory experience.
We leveraged TouchDesigner to convert digital signals from Ableton Live into visual information, creating dynamic images that change in sync with the music's rhythm. This allowed us to visually represent the musical interaction, enhancing the immersive experience of the exhibition by connecting audio outputs with engaging visual displays.
Testing Protocol
Survey
About the exhibition
Feeling
Emotion
Meaning of the project
Physicailty of the
device
Usability
Feed forward and feedback
Final Thoughts
Acceptability
Thoughts and Suggestions
Survey Results
All visitors gave a positive feedback overall and were very satisfied with the experience.
Overall satisfaction level with the experience
Emotional response to the experience
Emotions most experienced during the exhibition were:
Curiosity, Satisfaction, Excitement
Emotional response to the experience
3D printed iterations of the device
Majority of users preferred the final selected design. According to their feedback, the device was:
Easy to hold
Usable in both hands
Non-slip grip texture
Looks organic
Overview
PROBLEMS IDENTIFIED
Device is slightly small.
Sensor on the plant should be easier to attach and remove without harming the plant.
The visualizations could be more responsive to the touch input on the plants.
DISCOVERIES
A single device also works with several people touching each other, adding their own electrical signatures and creating a unified music.
Improvements
Key Changes
Size of the device to be bigger for a comfortable grip
Change to a clip sensor for more intuitive and safe attachment to plants
Physical Changes
App incorporates Machine Learning for plant identification through user uploaded photos
Device adapts to different plants, generating unique music scales accordingly
Incorporate visualizations from exhibition in the app
Digital Changes
App Improvements
To enhance user interaction and understanding of the plants they interact with, we incorporated a plant scanning module into the FloraTune app. This feature uses a model trained via Teachable Machine, enabling users to identify plants effectively by scanning them with the app. This addition has significantly improved the educational and interactive capabilities of our product
Due to the positive feedback received from the immersive visual experiences at the exhibition, we decided to enhance the mobile version of the FloraTune app by incorporating similar visual feedback animations for music. This feature mirrors the exhibition's dynamic response to musical inputs, bringing a cohesive and engaging user experience to the mobile platform
Musical Improvements
To better match the music generated with the plants users interact with in the FloraTune app, we designed specific chord types and associated emotions for different plants. This tailored approach ensures that the music not only reflects the unique characteristics of each plant but also enhances the emotional connection and interaction experience between the user and the plant.
Poppy
A minor
A, B, C, D, E, F, G
Oblivious,
plaintive
Olive
G major
G, A, B, C, D, E, F♯
Peaceful, calm,
satisfied
Yellow
Daisy
A major
A, B, C#, D, E, F#, G#
Happiness, joy,
innocence
Cypress
C minorE
C, D, E♭, F, G, A♭, B♭
Sorrow,
melancholy
Service Blueprint
New Scenario
User enters the exhibition space and different plants have FloraTune devices connected to them..
User picks up the device and holds it.
On touching the plant, the circuit is complete and music is generated with visualizations.
The user is interested in the project and is curious to try it out outside the exhibition context.
Limitations
The electronics used are too big and can’t fit into the final working device.
Device requires cable connection to a computer for real-time signal processing and music production.
Plant sensor could be retractable so the device is more compact.
Machine Learning would be introduced in the app with its full functionality.
The Future
Expanding FloraTune’s user and database globally to create a comprehensive library of plants that can ignite the passion for nature conservation.
Conduct research and gather data on the long-term effects of FloraTune experiences on individuals' behavior and attitudes towards nature, to further refine and optimize the program to create effective behavior change.
Explore the potential for FloraTune-inspired design principles to be implemented in urban planning and architecture, promoting sustainable and nature-centric cityscapes.
Continuously innovate and adapt FloraTune experiences to stay at the forefront of promoting a balanced connection with nature, considering evolving environmental challenges and societal needs.