Effects of a Person’s Facial Expressions in Video on Viewers’ Moods and Facial Expressions: Application to Interface Design

Abstract

The number of video-sharing sites, such as YouTube, in which it is easy to post and view moving images, continues to increase. This may result in viewers unconsciously experiencing psychological effects from the videos. In this research, we aim to clarify the effects of speakers’ facial expressions in videos on viewers. Our study investigated mood ratings and changes in viewers’ facial expressions while watching different facial expressions of a real human speaker in videos. The results showed ‘Happy Feelings’ and ‘Positivity’ to be rated significantly more highly after viewing moving images in which a speaker smiled while they were talking. The results of this study reveal the potential for making and posting videos in the light of the psychological effects on viewers, and for labelling the videos to enable the viewers to select and watch such videos. It is useful to make and post videos in which smiling persons talk, aiming to make the viewers happy and positive, and for viewers to select and watch such videos when they wish to feel happy and positive. Furthermore, based on the results of our study, we created online learning materials for children to help them enjoy learning English conversation. In the online learning materials, when a user selects the correct answer, the facial expression of the character changes to a smile. This visual feedback is expected not only to inform learners that their answer was correct but also to improve their mood and promote a more positive learning experience.

Keywords: Facial Expression, Video, Mood Rating, Smile, Viewers’ Moods, Interface Design

DOI: 10.54941/ahfe1006864