A Behavioral Observation Tool for Diagnosing Human–AI Interaction Profiles in Engineering Design Education
Abstract
The integration of generative Artificial Intelligence into engineering design education has created a practical challenge for instructors: how to recognize, in real time, how individual students are interacting with AI systems during laboratory sessions. While empirical research has identified three recurrent Human–AI interaction profiles — Cognitive Adapters, Functional Executors, and Skeptical Observers — existing diagnostic approaches rely on survey instruments and post-hoc analysis that are unsuitable for classroom use. This paper proposes a Behavioral Observation Tool (BOT) designed for use by instructors during laboratory sessions. The BOT consists of 17 behavioral indicators organized across five dimensions — goal formulation, output interpretation, iterative behavior, agency distribution, and reflective engagement — rated on a three-point scale. A weighted scoring system produces normalized profile scores that classify students into dominant, mixed, or indeterminate profiles. Profile-specific instructional guidelines, derived from an adaptive Human–AI interaction framework, translate classification outcomes into concrete teaching responses. An Excel-based scoring instrument accompanies the tool, automating calculation and classification without requiring statistical expertise. The BOT bridges the gap between empirical interaction research and everyday instructional practice, supporting reflective, differentiated, and human-centered AI integration in engineering education.
Keywords: Human–AI Interaction, Engineering Education, Behavioral Observation, Interaction Profiles, Instructional Design, Generative AI
DOI: 10.54941/ahfe1008245
Cite this paper
More from this volume
- AI-Enhanced Live-Streamed English Language Learning: Designing and Evaluating an Intelligent Platform for Chinese Learners
- "They Will Move": Confirmation Bias, Expectation Frames, and Premature Monitoring Drop Off in COLREG Encounters
- Automation transparency communication does not improve supervisory control performance, but shapes operator trust
- The influence of neuroticism on startle and surprise response: a flight simulator study
- EEG-Based Classification of Reward, Penalty, and Movement Events Across Four Video Games of Varying Complexity
- The Effects of Task Similarity and Time Pressure on Task Performance Following Interruptions in Complex Human-Computer Interaction Systems
- Trusting the Chain, Not the Black Box: A Provenance-Based Architecture for Human-Machine Teaming in Military Autonomy
- Design of a Simplified Humanoid Robot Face: Cultural Differences and Emotional Synchronization
- From Visual Observation to Auditory Interaction: A Human-Centered Tangible Music System Based on Physical Objects
- The Impact of Scarcity-Based Dark Patterns on User Performance, Perceived Darkness, and Workload in Subscription Services
- The Mediated Moon: Semantic Mediation Between Gesture and Generative Image
- A Sustainable Assistive Technology for Children with Visual Impairments


AHFE Open Access