Transcendental Sound Experiences:
Improving peaceful states of mind and reflection with sound-based interaction/experience design
This thesis explores the potential of virtual reality (VR) to alleviate overwhelm in young adults, a prevalent issue in today’s fast-paced society. It integrates psychoacoustic principles, specifically binaural beats and nature sounds, with interactive elements. Through a research-through-design approach, a VR prototype was developed, featuring Binaural beats, 360° natural scenes, audio-reactive particles, and generative audio to create a multi-sensory experience tailored to the needs and preferences of young adults. This research provides a framework for immersive VR applications aimed at stress reduction and mindfulness, demonstrating the therapeutic potential of multi-sensory experiences.
Details
Master Thesis
Date:
2024
Category:
Interactive, Audio, Editorial
Crafting the Experience
This project developed a VR experience to explore the therapeutic potential of binaural beats. It comprises:
- Visuals: Immersive natural and abstract environments created in Unity.
- Audio: Binaural beats, 360° environmental audio, and guided breathing exercises developed in Ableton Live.
- Interaction: Real-time audio analysis of user breathing, driving generative visuals and audio, using TouchDesigner and MAX/MSP. All elements are integrated for a cohesive VR experience.
Sound
Binaural Beats:
The binaural beats where created completely through Ableton Live 12, whereas the 3D Audio/Breathing Exercise track where recorded elsewhere and edited and mixed in Ableton.
- Two operators produced distinct signals at 34Hz and 40Hz, panned to each stereo channel. The brain perceives the 6Hz difference as a third frequency, corresponding to the theta brainwave range associated with relaxation.
- Low frequencies were chosen to blend seamlessly with natural soundscapes.
Binaural Beat
Natural 360° Soundscape
Interactive Sound
Audio Vocoder: Transforming Voice into Soundscapes
MAX/MSP was used to create a custom vocoder that transforms the user’s voice into generative ambient soundscapes. This allows for unique sonic interaction, where the user’s voice dynamically shapes the VR experience.
- Voice-Controlled Sound: The vocoder uses voice/breath input to modulate synthesized sound parameters (volume, pitch, etc.) for a unique and otherworldly audio experience.
- Dynamic & Immersive: A resonant filter and reverb create a constantly evolving, personalized, and immersive audio environment.
- Immersive Depth: Reverb adds spaciousness, enhancing the immersive quality of the sound.
Audio-Reactive Visuals:
TouchDesigner’s Magic
TouchDesigner was used to create an audio-reactive particle system, generating dynamic visuals that respond to the user’s voice or breath.
- Visual Sound Representation: Particles react to audio amplitude and frequency, creating a visually engaging experience.
- Dynamic Particle Behavior: Frequency content dictates particle size, speed, color, and movement, creating a captivating visual representation of sound.
VR
The entire VR experience was built using Unity as a cetral hub, which allowed for the creation of immersive 3D environments. There the binaural beats, audio-reactive particles, vocoder were integrated with 360-degree videos of natural scenes and an abstract scene.
- 360° Videos: Visually appealing and immersive environments were created using 360° videos and 3D audio.
- Abstract Environment: Provides a unique backdrop for interactive visual and auditory elements.
Editorial
A 101-page softcover book detailing the complete thesis journey. Includes research methodology, findings, and the development of a VR prototype. The cover features a custom square cutout and holographic print, emphasizing the project’s innovative approach.
