Human-Centered Design of AI Decision Support: Algorithmic Vigilance and the Role of AI Literacy
Abstract
Artificial intelligence is increasingly embedded in workplace decisions, yet practitioners oscillate between algorithm aversion and automation bias. Algorithmic vigilance, i.e. calibrated, critically reflective reliance on AI, is the normative design target, but it remains unclear what it looks like in everyday professional work and which conditions support it. Existing design principles largely stem from laboratory studies and treat AI literacy as the main individual moderator.This exploratory study combines interviews with 13 practitioners from construction, production planning and school administration with the Meta AI Literacy Scale (MAILS). Interview statements were quantitized into ordinal indicators and related to MAILS scores (Spearman's ρ). Practitioners unanimously retained decision authority and verified AI outputs. AI literacy tended to go with more specific transparency requirements (ρ = .44), whereas task complexity and decision criticality shaped explanation demand (ρ = .76 and .81) and automation affinity (ρ = −.55). AI literacy was unrelated to emotional security (ρ = .19) and emotion regulation (ρ = −.03); self-efficacy was associated with more systematic verification (ρ = .59).We derive five hypotheses and an extended model of algorithmic vigilance that adds task complexity as a second dimension next to AI literacy and locates emotional security in system design. The design implications are role- and task-sensitive transparency, active competence support and error-type-differentiated confidence communication, implemented through confirmation gates, calibrated confidence signals and configurable autonomy. A confirmatory study will test the hypotheses.
Keywords: AI Literacy · Algorithmic Vigilance · Automation Bias · Algorithm Aversion · Task Complexity · MAILS · Mixed Methods · Quantitizing
DOI: 10.54941/ahfe1008302
Cite this paper
More from this volume
- AI-Enhanced Live-Streamed English Language Learning: Designing and Evaluating an Intelligent Platform for Chinese Learners
- "They Will Move": Confirmation Bias, Expectation Frames, and Premature Monitoring Drop Off in COLREG Encounters
- Automation transparency communication does not improve supervisory control performance, but shapes operator trust
- The influence of neuroticism on startle and surprise response: a flight simulator study
- EEG-Based Classification of Reward, Penalty, and Movement Events Across Four Video Games of Varying Complexity
- The Effects of Task Similarity and Time Pressure on Task Performance Following Interruptions in Complex Human-Computer Interaction Systems
- Trusting the Chain, Not the Black Box: A Provenance-Based Architecture for Human-Machine Teaming in Military Autonomy
- Design of a Simplified Humanoid Robot Face: Cultural Differences and Emotional Synchronization
- From Visual Observation to Auditory Interaction: A Human-Centered Tangible Music System Based on Physical Objects
- The Impact of Scarcity-Based Dark Patterns on User Performance, Perceived Darkness, and Workload in Subscription Services
- A Behavioral Observation Tool for Diagnosing Human–AI Interaction Profiles in Engineering Design Education
- The Mediated Moon: Semantic Mediation Between Gesture and Generative Image


AHFE Open Access