Teaching Multimodal Interaction in Cars to First-time Users

Abstract: This study examines three variations of a proactive method for teaching multimodal gaze and gesture interactions to first-time users in the context of an SAE Level 5 automated vehicle. The three variations differed in size, placement on the screen, and whether active user input was required to receive additional information. The results of a user study involving the gesture control prototype in a driving simulator (N=30) show that the greatest variation was more effective in teaching, caused by significant differences in visibility ratings (𝑝<0.001), size (𝑝<0.001) and duration (𝑝=0.001) of the pop-ups. The results show no correlation between the measured effectiveness and the preference for a specific variation. Across all variations, participants are positive toward receiving proactive teaching from their car to learn new features. We conclude that proactively teaching users novel interaction methods has the potential to improve the user experience in future vehicles.

Keywords: User Interfaces, New Users, Multimodal Interaction, Gaze Control, Gesture Control

DOI: 10.54941/ahfe1007155

Cite this paper:

​