Eye-Tracking Factors During Spatial Ability Task Predict IRT-Based Item Difficulty and Naval Flight Training Performance
Abstract
Since WWI, spatial reasoning abilities have demonstrated strong predictive validity for aviation training success. Eye-tracking offers millisecond-level indexing of underlying cognitive mechanisms: visual attention, visual search, and cognitive load. 228 U.S. Naval flight students performed the Terrain Orientation Task (TOT) while eye-tracking was recorded. Exploratory factor analysis reduced eight eye-tracking metrics into three factors: Visual Search, Visual Attention, and Cognitive Load. Objective difficulty was calibrated via a two-parameter logistic Item Response Theory model. Harder TOT items induced significantly larger peak pupil dilations (b = 0.06, p < .001) and greater pupil trace area under the curve (b = 0.02, p < .001), confirming pupillometry as an online cognitive load gauge. With escalating difficulty, cognitive load rose (b = 0.04, p = .027) while visual search narrowed (b = -0.29, p < .001), reflecting load-induced scan tightening. At the trial-level, broader visual search conferred a ~30% increase in the odds of a correct response (p < .001). At the participant level, the interaction between visual search and visual attention predicted Naval Introductory Flight Evaluation (NIFE) academic performance (β = -0.189, p = .013). whereas flight performance was predicted by interaction between attention and cognitive load (β = -0.26, p = .006). Adding eye-tracking factors to traditional selection metrics improved prediction of NIFE academics (ΔR² = +7%) and flight performance (ΔR² = +10%), while markedly enhancing attrition prediction (ΔAUC = +15%). These findings demonstrate that eye-tracking provides valuable cognitive workload and strategic signatures to enhance aviator selection, difficulty titration, and targeted coaching.
Keywords: Aviation, Eye-Tracking, Training, Spatial Ability
DOI: 10.54941/ahfe1008488
Cite this paper
More from this volume
- AI-Enhanced Live-Streamed English Language Learning: Designing and Evaluating an Intelligent Platform for Chinese Learners
- "They Will Move": Confirmation Bias, Expectation Frames, and Premature Monitoring Drop Off in COLREG Encounters
- Automation transparency communication does not improve supervisory control performance, but shapes operator trust
- The influence of neuroticism on startle and surprise response: a flight simulator study
- EEG-Based Classification of Reward, Penalty, and Movement Events Across Four Video Games of Varying Complexity
- The Effects of Task Similarity and Time Pressure on Task Performance Following Interruptions in Complex Human-Computer Interaction Systems
- Trusting the Chain, Not the Black Box: A Provenance-Based Architecture for Human-Machine Teaming in Military Autonomy
- Design of a Simplified Humanoid Robot Face: Cultural Differences and Emotional Synchronization
- From Visual Observation to Auditory Interaction: A Human-Centered Tangible Music System Based on Physical Objects
- The Impact of Scarcity-Based Dark Patterns on User Performance, Perceived Darkness, and Workload in Subscription Services
- A Behavioral Observation Tool for Diagnosing Human–AI Interaction Profiles in Engineering Design Education
- The Mediated Moon: Semantic Mediation Between Gesture and Generative Image


AHFE Open Access