Measuring Mental Workload in Immersive Fighter-Flight Simulation: A Multimodal Approach
Abstract
Workload indicators in fighter aviation rarely agree, and it is not known in advance which one to trust. This study examined how subjective, performance and oculometric indicators associate, dissociate or remain insensitive in immersive fighter-flight simulation. Fifty-five military pilot trainees flew a virtual-reality mission crossing three flight phases (autopilot, low-altitude terrain following, air defense) with three secondary-task levels (memorization alone, or with one or two spatial decisions every 30 s), a 3 × 3 within-subjects design. Perceived workload (NASA-TLX) rose with both factors. Near-display gaze was the most sensitive indicator of task level, separating all three levels even outside the decision windows, yet it fell across flight phases, moving opposite to perceived workload on that factor. Decision performance did not change: Bayesian analyses favored the absence of an effect for every term except task level on accuracy, where they were inconclusive, and performance was stable at a modest level, with little room to degrade. SWORD ratings and gaze both revealed effort shifting toward the decision task. Recall of a concurrent memorization task registered the demand of flying (confounded with time on task), and the added decisions only in autopilot, where capacity remained to be consumed. Pupil diameter decreased as demand increased, a reversal attributable to the light emitted by the decision task rather than to cognitive load. Each indicator thus answered a different question, and which one depended on the factor varied. No single measure suffices in a realistic cockpit; this study maps what each one answers, for which factor, and when it can be read at all.
Keywords: Mental Workload, Multimodal Assessment, Immersive Flight Simulation, Eye Tracking, NASA-TLX
DOI: 10.54941/ahfe1008259
Cite this paper
More from this volume
- AI-Enhanced Live-Streamed English Language Learning: Designing and Evaluating an Intelligent Platform for Chinese Learners
- "They Will Move": Confirmation Bias, Expectation Frames, and Premature Monitoring Drop Off in COLREG Encounters
- Automation transparency communication does not improve supervisory control performance, but shapes operator trust
- The influence of neuroticism on startle and surprise response: a flight simulator study
- EEG-Based Classification of Reward, Penalty, and Movement Events Across Four Video Games of Varying Complexity
- The Effects of Task Similarity and Time Pressure on Task Performance Following Interruptions in Complex Human-Computer Interaction Systems
- Trusting the Chain, Not the Black Box: A Provenance-Based Architecture for Human-Machine Teaming in Military Autonomy
- Design of a Simplified Humanoid Robot Face: Cultural Differences and Emotional Synchronization
- From Visual Observation to Auditory Interaction: A Human-Centered Tangible Music System Based on Physical Objects
- The Impact of Scarcity-Based Dark Patterns on User Performance, Perceived Darkness, and Workload in Subscription Services
- A Behavioral Observation Tool for Diagnosing Human–AI Interaction Profiles in Engineering Design Education
- The Mediated Moon: Semantic Mediation Between Gesture and Generative Image


AHFE Open Access