When Helpful AI Feels Too Trustworthy: Engagement and Reliance in Design Ideation
Abstract
Artificial intelligence (AI) assistants are increasingly used in engineering ideation, but their effectiveness depends on both the AI model’s capabilities and how users interpret and act on AI feedback. This paper synthesizes human-factors findings from the development and evaluation of the AI Design Assistant (AIDA), a modular testbed for iterative engineering ideation, focusing on trust calibration, feedback presentation, user agency, and design exploration. Across studies, adaptive and socially responsive feedback generally increased trust and perceived usefulness, yet trust did not reliably correspond to measured design improvement. More feedback yielded mixed results: longer or highly structured responses were not consistently associated with stronger outcomes, while concise feedback and longer user revisions were associated with larger score gains in turn-level analyses. Users also applied AI guidance selectively; only 38.6% of actionable suggestions were implemented, although most revisions used at least one AI-generated suggestion. These findings suggest that the next generation of AI design assistants needs to support calibrated trust, reduce unnecessary information-processing demands, preserve explicit user control over suggestion use, and distinguish user perceptions from measured design outcomes. The results provide practical design guidance for human-centered AI systems that augment, rather than replace, human judgment during creative engineering work.
Keywords: Human-AI Collaboration, Decision Support, Trustworthy AI, Adaptive System
DOI: 10.54941/ahfe1008303
Cite this paper
More from this volume
- AI-Enhanced Live-Streamed English Language Learning: Designing and Evaluating an Intelligent Platform for Chinese Learners
- "They Will Move": Confirmation Bias, Expectation Frames, and Premature Monitoring Drop Off in COLREG Encounters
- Automation transparency communication does not improve supervisory control performance, but shapes operator trust
- The influence of neuroticism on startle and surprise response: a flight simulator study
- EEG-Based Classification of Reward, Penalty, and Movement Events Across Four Video Games of Varying Complexity
- The Effects of Task Similarity and Time Pressure on Task Performance Following Interruptions in Complex Human-Computer Interaction Systems
- Trusting the Chain, Not the Black Box: A Provenance-Based Architecture for Human-Machine Teaming in Military Autonomy
- Design of a Simplified Humanoid Robot Face: Cultural Differences and Emotional Synchronization
- From Visual Observation to Auditory Interaction: A Human-Centered Tangible Music System Based on Physical Objects
- The Impact of Scarcity-Based Dark Patterns on User Performance, Perceived Darkness, and Workload in Subscription Services
- A Behavioral Observation Tool for Diagnosing Human–AI Interaction Profiles in Engineering Design Education
- The Mediated Moon: Semantic Mediation Between Gesture and Generative Image


AHFE Open Access