Remote Cheering System with Voice in Live Streaming

Abstract

In recent years, live streaming has become the mainstream. Because the music live has been canceled or postponed by the influence of the new coronavirus infection. Even now that the number of infected people is decreasing, hybrid live performances with both concert and live streaming are being held. Live streaming can reduce travel costs and time, so it has the merit of being able to watch it easily. However, it is difficult to feel a sense of unity and presence, and it does not create more excitement than concert. It has become a problem in the music industry. In order to solve this problem, we think it is necessary to pay attention to the presence or absence of audience sharing the same place and voice, which is a big difference between concert and live streaming. This study examines how to make it satisfactory live where we can feel a sense of unity and presence even if we are alone at home in a live streaming. To this end, we clarified the behavior of the audience watching concert and analyzed how to cheer.Therefore, we conducted a survey of the excitement of it based on the pyramid of Freytag.We investigated the behavior of the audience from concert videos of idols, singers and rock bands. As a result, audience’s cheering method has three types of cheering: those using voice, those using hands and those using entire body. Cheering using voice plays an important role in deciding the excitement.Live streaming has comments, social tipping, and posting on SNS as a service. However, none of them share the voice of the audience. This analysis clarified the reason why live streaming is not more exciting than concert. Thereby we considered that sharing emotions aloud between the audience create a sense of unity in live streaming. From the above, we produce a live streaming cheering system using voice. This system uses the call program to communicate with other audiences, visualize the voice of the audience and project it on the screen. It’s mechanism that increases the number of effects that express excitement as the audience’s voice gets louder. We produce it to use TouchDesigner. Moreover, subjects watched the concert video with this system. we experimented with whether the subject felt a sense of unity and presence compared to conventional live streaming. Subjects were able to shout even more by sharing voices with other audiences and visualizing their voices. In addition, conventional live streaming shared emotions by discussing their impressions with other audiences using SNS. By contrast, this system can share emotions directly through the call program, which makes it more exciting. On the other hand, subjects have an opinion that it would be better to project effects tailored to the concept of songs and concerts on the screen so that the audience would not get bored. Therefore, this system is room for the development. From this experiment, the remote cheering system using voice improve the concert experience at home.

Keywords: sound design, interaction, kansei, user experience

DOI: 10.54941/ahfe1001753