Terrain Orientation Test Predicts Navy Flight Training Outcomes in High and Low Stakes Settings

Open Access
Article
Conference Proceedings
Authors: Joseph Coyne, Ciara Sibley, Kaylin Strong, Michael Kukenberger
Abstract

This study evaluates the predictive validity of the U.S. Navy's Terrain Orientation Task (TOT), a spatial ability test for pilot selection introduced in 2023. The new test was developed after a previous one lost its effectiveness, partly due to applicants learning test-taking "tricks." However, a replica of the new TOT appeared online shortly after its official rollout, raising concerns about its continued validity. To investigate this, researchers studied 200 flight students who had already taken the TOT as part of their official Aviation Selection Test Battery (ASTB). In a low-stakes lab setting, the students completed the TOT again, practiced it extensively, and then took an alternate version. The results showed that scores from the official high-stakes test and both low-stakes lab attempts were all significantly correlated with the students' flight training grades. While practice did improve scores, the test remained a valid predictor of training outcomes. The study concludes that the TOT is a robust predictor of pilot performance in both high- and low-stakes settings, even with replicas available online. The authors recommend continued monitoring and leveraging the TOT's ability to generate new items to maintain its long-term integrity.

Keywords: Aviation Selection, Spatial Ability, Individual Differences

DOI: 10.54941/ahfe1008500

Cite this paper
Downloads
0
Visits
1
Download PDF

More from this volume

← Sensing the Seasons: Exploring Preschoolers' Seasonal Cognition through Multisensory InteractionDetection Without Speed Isn’t Defense: Human-AI Coordination Against Cognitive Cyberattackers →
View all articles in Human Factors in Design, Engineering, and Computing →