Room-Scale Digital Twin Sensing for Quantifying Young Children's Gaze-Based Interest and Movement Behavior
Abstract
This study proposes a room-scale digital twin sensing system for jointly quantifying young children’s gaze-based interest and movement behavior within the same three-dimensional environment. The system integrates skeletal data acquired from multiple Azure Kinect sensors, a three-dimensional point cloud model of the room, and stimulus-state data within a unified coordinate system. Gaze-based interest is estimated from head orientation and visualized as an interest heatmap, while movement behavior is quantified using cosine similarity between the child’s movement direction and each target direction. As a proof-of-concept study, the system was validated in a stimulus-controlled room where the brightness and color of visual targets could be electronically controlled. Experiments with two four-year-old children showed that the activated LED target achieved the highest interest score and movement-direction score under all tested conditions. These results demonstrate the feasibility of integrating gaze-based interest estimation and movement-direction analysis within a common room-scale digital twin, providing a technical basis for quantifying how children visually attend to and move within everyday environments.
Keywords: Digital Twin Sensing, Young Children, Gaze-Based Interest, Movement Behavior, Stimulus-Controlled Room, Interest Heatmap, Child Safety
DOI: 10.54941/ahfe1008409
Cite this paper
More from this volume
- AI-Enhanced Live-Streamed English Language Learning: Designing and Evaluating an Intelligent Platform for Chinese Learners
- "They Will Move": Confirmation Bias, Expectation Frames, and Premature Monitoring Drop Off in COLREG Encounters
- Automation transparency communication does not improve supervisory control performance, but shapes operator trust
- The influence of neuroticism on startle and surprise response: a flight simulator study
- EEG-Based Classification of Reward, Penalty, and Movement Events Across Four Video Games of Varying Complexity
- The Effects of Task Similarity and Time Pressure on Task Performance Following Interruptions in Complex Human-Computer Interaction Systems
- Trusting the Chain, Not the Black Box: A Provenance-Based Architecture for Human-Machine Teaming in Military Autonomy
- Design of a Simplified Humanoid Robot Face: Cultural Differences and Emotional Synchronization
- From Visual Observation to Auditory Interaction: A Human-Centered Tangible Music System Based on Physical Objects
- The Impact of Scarcity-Based Dark Patterns on User Performance, Perceived Darkness, and Workload in Subscription Services
- A Behavioral Observation Tool for Diagnosing Human–AI Interaction Profiles in Engineering Design Education
- The Mediated Moon: Semantic Mediation Between Gesture and Generative Image


AHFE Open Access