The Immersive Power of Binaural Sound: Reproducing the Experience of a Music Festival
Abstract
Immersive technologies overwhelmingly prioritize visual fidelity and leave the auditory channel comparatively under-exploited, even though spatial sound is a powerful driver of presence. This study examined whether binaural (3D) sound can reproduce the experience of a live music festival in a digital setting, and how auditory and visual information combine to support immersion and emotional response. Performances at the 2025 Fono Festival in Québec City were recorded on site using a Neumann KU 100 dummy head paired with a head-mounted camera, which yielded binaural and standard stereo versions of the same performance at capture. Because spatial encoding occurs acoustically in the dummy head rather than being synthesized in post-production, the binaural signal preserves the complete auditory scene with its natural localization cues. Forty-eight adults, half of whom had attended the festival in person, experienced songs in binaural or stereo, with or without visual support, in a counterbalanced within-subject design. Without visual support, binaural sound elicited significantly greater presence and immersion than stereo, and binaural audio alone matched the immersive quality of audiovisual stereo. Adding video raised stereo to binaural levels but produced no further gain for binaural. The audio format had no effect on perceived clarity or readability of the sound. Visual support heightened arousal without affecting valence, and emotional responses were positive and moderately intense whether or not participants had attended the festival. Attendees judged the reproduction authentic in ambience and emotion, though not as immersive as being there. Because binaural delivery requires only headphones, it offers an accessible route to immersive experience.
Keywords: Binaural Audio, Spatial Sound, Presence, Immersion, Multisensory Integration, Live Music, Emotional Response
DOI: 10.54941/ahfe1008513
Cite this paper
More from this volume
- AI-Enhanced Live-Streamed English Language Learning: Designing and Evaluating an Intelligent Platform for Chinese Learners
- "They Will Move": Confirmation Bias, Expectation Frames, and Premature Monitoring Drop Off in COLREG Encounters
- Automation transparency communication does not improve supervisory control performance, but shapes operator trust
- The influence of neuroticism on startle and surprise response: a flight simulator study
- EEG-Based Classification of Reward, Penalty, and Movement Events Across Four Video Games of Varying Complexity
- The Effects of Task Similarity and Time Pressure on Task Performance Following Interruptions in Complex Human-Computer Interaction Systems
- Trusting the Chain, Not the Black Box: A Provenance-Based Architecture for Human-Machine Teaming in Military Autonomy
- Design of a Simplified Humanoid Robot Face: Cultural Differences and Emotional Synchronization
- From Visual Observation to Auditory Interaction: A Human-Centered Tangible Music System Based on Physical Objects
- The Impact of Scarcity-Based Dark Patterns on User Performance, Perceived Darkness, and Workload in Subscription Services
- A Behavioral Observation Tool for Diagnosing Human–AI Interaction Profiles in Engineering Design Education
- The Mediated Moon: Semantic Mediation Between Gesture and Generative Image


AHFE Open Access