Terrain Orientation Test Predicts Navy Flight Training Outcomes in High and Low Stakes Settings
Abstract
This study evaluates the predictive validity of the U.S. Navy's Terrain Orientation Task (TOT), a spatial ability test for pilot selection introduced in 2023. The new test was developed after a previous one lost its effectiveness, partly due to applicants learning test-taking "tricks." However, a replica of the new TOT appeared online shortly after its official rollout, raising concerns about its continued validity. To investigate this, researchers studied 200 flight students who had already taken the TOT as part of their official Aviation Selection Test Battery (ASTB). In a low-stakes lab setting, the students completed the TOT again, practiced it extensively, and then took an alternate version. The results showed that scores from the official high-stakes test and both low-stakes lab attempts were all significantly correlated with the students' flight training grades. While practice did improve scores, the test remained a valid predictor of training outcomes. The study concludes that the TOT is a robust predictor of pilot performance in both high- and low-stakes settings, even with replicas available online. The authors recommend continued monitoring and leveraging the TOT's ability to generate new items to maintain its long-term integrity.
Keywords: Aviation Selection, Spatial Ability, Individual Differences
DOI: 10.54941/ahfe1008500
Cite this paper
More from this volume
- AI-Enhanced Live-Streamed English Language Learning: Designing and Evaluating an Intelligent Platform for Chinese Learners
- "They Will Move": Confirmation Bias, Expectation Frames, and Premature Monitoring Drop Off in COLREG Encounters
- Automation transparency communication does not improve supervisory control performance, but shapes operator trust
- The influence of neuroticism on startle and surprise response: a flight simulator study
- EEG-Based Classification of Reward, Penalty, and Movement Events Across Four Video Games of Varying Complexity
- The Effects of Task Similarity and Time Pressure on Task Performance Following Interruptions in Complex Human-Computer Interaction Systems
- Trusting the Chain, Not the Black Box: A Provenance-Based Architecture for Human-Machine Teaming in Military Autonomy
- Design of a Simplified Humanoid Robot Face: Cultural Differences and Emotional Synchronization
- From Visual Observation to Auditory Interaction: A Human-Centered Tangible Music System Based on Physical Objects
- The Impact of Scarcity-Based Dark Patterns on User Performance, Perceived Darkness, and Workload in Subscription Services
- A Behavioral Observation Tool for Diagnosing Human–AI Interaction Profiles in Engineering Design Education
- The Mediated Moon: Semantic Mediation Between Gesture and Generative Image


AHFE Open Access