The Immersive Power of Binaural Sound: Reproducing the Experience of a Music Festival

Open Access
Article
Conference Proceedings
Authors: Coralie Bureau, Jeanne Nicole, Cindy Chamberland, Alysun Paradis, Calypso Cases, Sébastien Tremblay
Abstract

Immersive technologies overwhelmingly prioritize visual fidelity and leave the auditory channel comparatively under-exploited, even though spatial sound is a powerful driver of presence. This study examined whether binaural (3D) sound can reproduce the experience of a live music festival in a digital setting, and how auditory and visual information combine to support immersion and emotional response. Performances at the 2025 Fono Festival in Québec City were recorded on site using a Neumann KU 100 dummy head paired with a head-mounted camera, which yielded binaural and standard stereo versions of the same performance at capture. Because spatial encoding occurs acoustically in the dummy head rather than being synthesized in post-production, the binaural signal preserves the complete auditory scene with its natural localization cues. Forty-eight adults, half of whom had attended the festival in person, experienced songs in binaural or stereo, with or without visual support, in a counterbalanced within-subject design. Without visual support, binaural sound elicited significantly greater presence and immersion than stereo, and binaural audio alone matched the immersive quality of audiovisual stereo. Adding video raised stereo to binaural levels but produced no further gain for binaural. The audio format had no effect on perceived clarity or readability of the sound. Visual support heightened arousal without affecting valence, and emotional responses were positive and moderately intense whether or not participants had attended the festival. Attendees judged the reproduction authentic in ambience and emotion, though not as immersive as being there. Because binaural delivery requires only headphones, it offers an accessible route to immersive experience.

Keywords: Binaural Audio, Spatial Sound, Presence, Immersion, Multisensory Integration, Live Music, Emotional Response

DOI: 10.54941/ahfe1008513

Cite this paper
Downloads
0
Visits
1
Download PDF

More from this volume

← Exploring User Affect in Virtual Reality Cultural Heritage Learning Using EEGWearable Multimodal Sensing for Pilot Stress and Fatigue Monitoring Across Real-World Flight Phases →
View all articles in Human Factors in Design, Engineering, and Computing →