Design and Experience Improvement of Multi-sensory AI Products for Human-Computer Interaction with Autistic Children

Abstract

Many intelligent products for children fail to meet the needs of those with autism, often due to single interaction modes and a lack of personalized feedback. To address this, we designed a multi-sensory AI system specifically for children with autism, aged 4–6 years. Our approach integrates human factors engineering with special education principles. The system uses a hybrid interface combining a smart terminal with physical building blocks that provide tactile, visual, and auditory feedback. An AI engine personalizes tasks and regulates sensory input. We evaluated the system with 40 autistic children in a controlled experiment. Results indicate that compared to a standard touch-screen game, our system significantly improved task completion rates and reduced completion time. It also increased effective interaction duration and reduced the frequency of sensory rejection behaviors. Children using our system showed a higher proportion of positive emotional responses. This work offers a practical framework for designing more accessible, adaptive AI tools for special education.

Keywords: Multi-sensory Fusion, Artificial Intelligence, Children’s Intelligent Products, Human-computer Interaction, User Experience, Affective Computing

DOI: 10.54941/ahfe1008029