A Behavioral Observation Tool for Diagnosing Human–AI Interaction Profiles in Engineering Design Education

Open Access
Article
Conference Proceedings
Authors: Stefano Filippi
Abstract

The integration of generative Artificial Intelligence into engineering design education has created a practical challenge for instructors: how to recognize, in real time, how individual students are interacting with AI systems during laboratory sessions. While empirical research has identified three recurrent Human–AI interaction profiles — Cognitive Adapters, Functional Executors, and Skeptical Observers — existing diagnostic approaches rely on survey instruments and post-hoc analysis that are unsuitable for classroom use. This paper proposes a Behavioral Observation Tool (BOT) designed for use by instructors during laboratory sessions. The BOT consists of 17 behavioral indicators organized across five dimensions — goal formulation, output interpretation, iterative behavior, agency distribution, and reflective engagement — rated on a three-point scale. A weighted scoring system produces normalized profile scores that classify students into dominant, mixed, or indeterminate profiles. Profile-specific instructional guidelines, derived from an adaptive Human–AI interaction framework, translate classification outcomes into concrete teaching responses. An Excel-based scoring instrument accompanies the tool, automating calculation and classification without requiring statistical expertise. The BOT bridges the gap between empirical interaction research and everyday instructional practice, supporting reflective, differentiated, and human-centered AI integration in engineering education.

Keywords: Human–AI Interaction, Engineering Education, Behavioral Observation, Interaction Profiles, Instructional Design, Generative AI

DOI: 10.54941/ahfe1008245

Cite this paper
Downloads
0
Visits
1
Download PDF

More from this volume

← The Impact of Scarcity-Based Dark Patterns on User Performance, Perceived Darkness, and Workload in Subscription ServicesThe Mediated Moon: Semantic Mediation Between Gesture and Generative Image →
View all articles in Human Factors in Design, Engineering, and Computing →