From Generic HMI to Driver-Adaptive Automation: Multimodal Feedback, Mode Awareness and Customized Takeover Timing

Open Access
Article
Conference Proceedings
Authors: Turkan Hentati, Rosen Dimov, Oana Moldovan
Abstract

Current European regulations and guidelines for Human-Machine Interfaces (HMIs) in automated vehicles provide an important framework for safety evaluation, although some aspects can remain open by stakeholders from the automotive industry when translated into practical evaluation criteria. For instance, concepts such as “timely warning” do not always specify precise temporal thresholds, while assumptions based on an “average driver” may overlook substantial differences in cognitive processing speed, attentional capacity, expertise, and mode awareness. These considerations are particularly critical during transitions between manual and automated driving, where proportionate awareness of the current automation mode can contribute to inappropriate driver responses and delayed takeovers. This paper presents the experimental protocol of Use Case 1 (UC1-HMI) of the CERTAIN project, which applies an inclusive, driver-centred approach to investigate how adding haptic feedback to conventional audio-visual warnings influences mode awareness and Take-Over Request (TOR) performance, and how warning techniques should be quantitatively adapted to different driver profiles. In this experiment, fifty participants stratified by driving expertise (novice/experienced), age (including adults 60+) and neurocognitive diversity (including ADHD), with gender balance, complete a 2-hour simulator session covering manual driving, SAE Level 2 hands-on and Level 3 hands-off automation across a seven-step highway-to-urban transition scenario. Two warning conditions are compared between groups: audio-visual feedback alone versus audio-visual feedback combined with haptic stimulation. Data triangulate subjective measures (NASA-TLX, Technology Acceptance Model, comfort and trust ratings, mode-confusion survey), the E3D Incabin physiological monitoring system, and a video-cued walkthrough interview. The paper presents the protocol, the research questions, the expected outcomes in light of prior literature, and the next steps, a second design iteration informed by these findings, toward adaptive, evidence-based warning strategies that replace universal HMI thresholds with driver-adaptive ones.

Keywords: Human-Machine Interface, Mode Awareness, Take-Over Request, Multimodal Feedback, Driver-Adaptive Automation, Haptic Feedback, Inclusive Design

DOI: 10.54941/ahfe1008312

Cite this paper
Downloads
0
Visits
1
Download PDF

More from this volume

← A User-Centred Design Approach for Inclusive and Trustworthy Human-Machine Interfaces in AI-based CCAM SystemsA Human-Centered Framework for AI-Wearable Integration in Automotive Assembly Lines →
View all articles in Human Factors in Design, Engineering, and Computing →