Creating a Path to Mastery: Impacts of Machine-Learning Guidance on Novice Software Users
Abstract
Novice users of complex software often face a steep learning curve, and many disengage before reaching proficiency. This study examined whether machine-learning-guided, in-application scaffolding can lower that barrier. Using cognitive apprenticeship theory (Collins, 2012) as a framework, an online study with U.S. science teachers tested a novel creative software environment, the DaVinci Science Comic Maker (DSCM). In the experimental condition, a machine-learning algorithm adjusted the complexity of available tools and supports to each user’s demonstrated skill level; the control condition offered no scaffolding and full tool complexity from the outset, mirroring typical unsupported software adoption. Participants created three comics within DSCM and completed a survey drawn from the Unified Theory of Acceptance and Use of Technology (UTAUT; Venkatesh et al., 2003). Three data sources were analyzed: artifact complexity and efficiency scores, clickstream data, and UTAUT responses. Experimental-group participants produced increasingly complex comics across trials (F(2,18) = 17.60, p < .001), while control-group complexity did not change (F(2,20) = 0.36, p = .705). The experimental group also used fewer clicks to complete its first comic. No significant between-group differences emerged on UTAUT subscales. These findings suggest that machine-learning-enabled cognitive apprenticeship scaffolding can support measurable skill growth among novice software users without external training, with implications for reducing adoption barriers in educational contexts and for the future design of complex creative software environments.
Keywords: Machine Learning, Cognitive Apprenticeship, Adaptive Scaffolding, Novice Software Users, Human-Computer Interaction
DOI: 10.54941/ahfe1008285
Cite this paper
More from this volume
- AI-Enhanced Live-Streamed English Language Learning: Designing and Evaluating an Intelligent Platform for Chinese Learners
- "They Will Move": Confirmation Bias, Expectation Frames, and Premature Monitoring Drop Off in COLREG Encounters
- Automation transparency communication does not improve supervisory control performance, but shapes operator trust
- The influence of neuroticism on startle and surprise response: a flight simulator study
- EEG-Based Classification of Reward, Penalty, and Movement Events Across Four Video Games of Varying Complexity
- The Effects of Task Similarity and Time Pressure on Task Performance Following Interruptions in Complex Human-Computer Interaction Systems
- Trusting the Chain, Not the Black Box: A Provenance-Based Architecture for Human-Machine Teaming in Military Autonomy
- Design of a Simplified Humanoid Robot Face: Cultural Differences and Emotional Synchronization
- From Visual Observation to Auditory Interaction: A Human-Centered Tangible Music System Based on Physical Objects
- The Impact of Scarcity-Based Dark Patterns on User Performance, Perceived Darkness, and Workload in Subscription Services
- A Behavioral Observation Tool for Diagnosing Human–AI Interaction Profiles in Engineering Design Education
- The Mediated Moon: Semantic Mediation Between Gesture and Generative Image


AHFE Open Access