Development and Evaluation of Applications for Oral and Cognitive Rehabilitation: A Facial Rock–Paper–Scissors Program with Psychological Effects
Abstract
We developed a “Facial rock-paper-scissors” program for oral and cognitive rehabilitation by incorporating mouth and cheek movements, and vocalizations used in swallowing training into the facial expressions and vocalizations of “rock,” “paper,” and “scissors.” In basic research, we investigated psychological evaluations when multiple programs with different facial-expression setting rules were implemented. The results showed improved mood when using a program in which the “scissors” expression involved stretching the mouth horizontally and raising the corners of the mouth to form a smiling face. Based on these results, we established a facial-expression setting for the program expected to produce positive psychological effects. Next, we developed two applications with different difficulty levels that allow users to easily perform the program. Both applications consist of a practice session for experiencing facial expressions and vocalizations, and a practical session. In the practical sessions, the system uses the tablet’s camera to recognize the user’s facial expressions and enables judgments of “win,” “lose,” and “draw,” thereby encouraging users’ motivation and promoting continuous engagement in rehabilitation. Practical evaluations of the applications conducted with a community-dwelling older adult suggested that implementing the program may have positive psychological effects such as increased vitality, pleasure, and arousal, may have cognitive function effects such as improved concentration and attention, and may contribute to improvements in orbicularis oris muscle strength. The developed applications were suggested to provide an engaging experience that contributes to users’ physical and mental functions.
Keywords: Application, Oral and Cognitive Functions, Rehabilitation, Psychological Effect, Facial Rock-Paper-Scissors
DOI: 10.54941/ahfe1008458
Cite this paper
More from this volume
- AI-Enhanced Live-Streamed English Language Learning: Designing and Evaluating an Intelligent Platform for Chinese Learners
- "They Will Move": Confirmation Bias, Expectation Frames, and Premature Monitoring Drop Off in COLREG Encounters
- Automation transparency communication does not improve supervisory control performance, but shapes operator trust
- The influence of neuroticism on startle and surprise response: a flight simulator study
- EEG-Based Classification of Reward, Penalty, and Movement Events Across Four Video Games of Varying Complexity
- The Effects of Task Similarity and Time Pressure on Task Performance Following Interruptions in Complex Human-Computer Interaction Systems
- Trusting the Chain, Not the Black Box: A Provenance-Based Architecture for Human-Machine Teaming in Military Autonomy
- Design of a Simplified Humanoid Robot Face: Cultural Differences and Emotional Synchronization
- From Visual Observation to Auditory Interaction: A Human-Centered Tangible Music System Based on Physical Objects
- The Impact of Scarcity-Based Dark Patterns on User Performance, Perceived Darkness, and Workload in Subscription Services
- A Behavioral Observation Tool for Diagnosing Human–AI Interaction Profiles in Engineering Design Education
- The Mediated Moon: Semantic Mediation Between Gesture and Generative Image


AHFE Open Access