Eye-Tracking Factors During Spatial Ability Task Predict IRT-Based Item Difficulty and Naval Flight Training Performance

Open Access
Article
Conference Proceedings
Authors: Alejandro Albizu, Laura Jamison, Kaylin Strong, Kayla Russell, Ciara Sibley, Shannon McGarry, Noelle Brown, Christopher Draheim, Cyrus Foroughi, Rebecca Nesmith, Sarah Melick, Joseph Coyne
Abstract

Since WWI, spatial reasoning abilities have demonstrated strong predictive validity for aviation training success. Eye-tracking offers millisecond-level indexing of underlying cognitive mechanisms: visual attention, visual search, and cognitive load. 228 U.S. Naval flight students performed the Terrain Orientation Task (TOT) while eye-tracking was recorded. Exploratory factor analysis reduced eight eye-tracking metrics into three factors: Visual Search, Visual Attention, and Cognitive Load. Objective difficulty was calibrated via a two-parameter logistic Item Response Theory model. Harder TOT items induced significantly larger peak pupil dilations (b = 0.06, p < .001) and greater pupil trace area under the curve (b = 0.02, p < .001), confirming pupillometry as an online cognitive load gauge. With escalating difficulty, cognitive load rose (b = 0.04, p = .027) while visual search narrowed (b = -0.29, p < .001), reflecting load-induced scan tightening. At the trial-level, broader visual search conferred a ~30% increase in the odds of a correct response (p < .001). At the participant level, the interaction between visual search and visual attention predicted Naval Introductory Flight Evaluation (NIFE) academic performance (β = -0.189, p = .013). whereas flight performance was predicted by interaction between attention and cognitive load (β = -0.26, p = .006). Adding eye-tracking factors to traditional selection metrics improved prediction of NIFE academics (ΔR² = +7%) and flight performance (ΔR² = +10%), while markedly enhancing attrition prediction (ΔAUC = +15%). These findings demonstrate that eye-tracking provides valuable cognitive workload and strategic signatures to enhance aviator selection, difficulty titration, and targeted coaching.

Keywords: Aviation, Eye-Tracking, Training, Spatial Ability

DOI: 10.54941/ahfe1008488

Cite this paper
Downloads
0
Visits
1
Download PDF

More from this volume

← Exploring Spatial and Psychological Factors Associated with Creativity in Office WorkersA Controlled Comparison of MARL Training-Execution Paradigms for Cooperative Multi-UAV Fire Detection →
View all articles in Human Factors in Design, Engineering, and Computing →