From Generic HMI to Driver-Adaptive Automation: Multimodal Feedback, Mode Awareness and Customized Takeover Timing
Abstract
Current European regulations and guidelines for Human-Machine Interfaces (HMIs) in automated vehicles provide an important framework for safety evaluation, although some aspects can remain open by stakeholders from the automotive industry when translated into practical evaluation criteria. For instance, concepts such as “timely warning” do not always specify precise temporal thresholds, while assumptions based on an “average driver” may overlook substantial differences in cognitive processing speed, attentional capacity, expertise, and mode awareness. These considerations are particularly critical during transitions between manual and automated driving, where proportionate awareness of the current automation mode can contribute to inappropriate driver responses and delayed takeovers. This paper presents the experimental protocol of Use Case 1 (UC1-HMI) of the CERTAIN project, which applies an inclusive, driver-centred approach to investigate how adding haptic feedback to conventional audio-visual warnings influences mode awareness and Take-Over Request (TOR) performance, and how warning techniques should be quantitatively adapted to different driver profiles. In this experiment, fifty participants stratified by driving expertise (novice/experienced), age (including adults 60+) and neurocognitive diversity (including ADHD), with gender balance, complete a 2-hour simulator session covering manual driving, SAE Level 2 hands-on and Level 3 hands-off automation across a seven-step highway-to-urban transition scenario. Two warning conditions are compared between groups: audio-visual feedback alone versus audio-visual feedback combined with haptic stimulation. Data triangulate subjective measures (NASA-TLX, Technology Acceptance Model, comfort and trust ratings, mode-confusion survey), the E3D Incabin physiological monitoring system, and a video-cued walkthrough interview. The paper presents the protocol, the research questions, the expected outcomes in light of prior literature, and the next steps, a second design iteration informed by these findings, toward adaptive, evidence-based warning strategies that replace universal HMI thresholds with driver-adaptive ones.
Keywords: Human-Machine Interface, Mode Awareness, Take-Over Request, Multimodal Feedback, Driver-Adaptive Automation, Haptic Feedback, Inclusive Design
DOI: 10.54941/ahfe1008312
Cite this paper
More from this volume
- AI-Enhanced Live-Streamed English Language Learning: Designing and Evaluating an Intelligent Platform for Chinese Learners
- "They Will Move": Confirmation Bias, Expectation Frames, and Premature Monitoring Drop Off in COLREG Encounters
- Automation transparency communication does not improve supervisory control performance, but shapes operator trust
- The influence of neuroticism on startle and surprise response: a flight simulator study
- EEG-Based Classification of Reward, Penalty, and Movement Events Across Four Video Games of Varying Complexity
- The Effects of Task Similarity and Time Pressure on Task Performance Following Interruptions in Complex Human-Computer Interaction Systems
- Trusting the Chain, Not the Black Box: A Provenance-Based Architecture for Human-Machine Teaming in Military Autonomy
- Design of a Simplified Humanoid Robot Face: Cultural Differences and Emotional Synchronization
- From Visual Observation to Auditory Interaction: A Human-Centered Tangible Music System Based on Physical Objects
- The Impact of Scarcity-Based Dark Patterns on User Performance, Perceived Darkness, and Workload in Subscription Services
- A Behavioral Observation Tool for Diagnosing Human–AI Interaction Profiles in Engineering Design Education
- The Mediated Moon: Semantic Mediation Between Gesture and Generative Image


AHFE Open Access