Development of a Game Application Using Texture-Related Onomatopoeia with a Focus on Declined Texture Recognition in Dementia
Abstract
Texture recognition is an important component of everyday cognition, supporting the ability to infer material properties such as softness, roughness, smoothness, and slipperiness from visual information. Previous research has demonstrated that the visual texture recognition ability of patients with dementia is significantly lower than that of healthy individuals across various materials. These findings suggest that changes in texture recognition ability may serve as a useful indicator for the early detection of dementia. Our previous studies have shown that the Sound Symbolic Words Texture Recognition Test (SSWTRT) is a simple cognitive screening method that imposes a low burden on participants and is designed to evaluate cognitive decline using sound-symbolic words (SSWs). The objective of the present study was to develop an SSW-based game application that focuses on the decline in texture recognition ability associated with dementia and supports early screening through enjoyable interaction. We developed a two-phase game. The first phase consists of a falling-object collection task in which fruit items with different visual textures fall from the top of the screen, and players collect the items that match a target texture. The second phase consists of a sorting task in which players select the SSW that best matches each collected fruit from eight alternatives: fuwa-fuwa (fluffy), gotsu-gotsu (rugged), zara-zara (rough), tsuru-tsuru (smooth), sara-sara (dry/silky), sube-sube (sleek), deko-boko (uneven), and nuru-nuru (slimy). A scoring method was designed to evaluate responses in the sorting phase not simply as correct or incorrect, but according to the empirical distribution of SSW choices obtained from young, healthy participants in previous studies.
Keywords: Dementia Screening, Texture Recognition, Sound-Symbolic Words, Serious Game
DOI: 10.54941/ahfe1008456
Cite this paper
More from this volume
- AI-Enhanced Live-Streamed English Language Learning: Designing and Evaluating an Intelligent Platform for Chinese Learners
- "They Will Move": Confirmation Bias, Expectation Frames, and Premature Monitoring Drop Off in COLREG Encounters
- Automation transparency communication does not improve supervisory control performance, but shapes operator trust
- The influence of neuroticism on startle and surprise response: a flight simulator study
- EEG-Based Classification of Reward, Penalty, and Movement Events Across Four Video Games of Varying Complexity
- The Effects of Task Similarity and Time Pressure on Task Performance Following Interruptions in Complex Human-Computer Interaction Systems
- Trusting the Chain, Not the Black Box: A Provenance-Based Architecture for Human-Machine Teaming in Military Autonomy
- Design of a Simplified Humanoid Robot Face: Cultural Differences and Emotional Synchronization
- From Visual Observation to Auditory Interaction: A Human-Centered Tangible Music System Based on Physical Objects
- The Impact of Scarcity-Based Dark Patterns on User Performance, Perceived Darkness, and Workload in Subscription Services
- A Behavioral Observation Tool for Diagnosing Human–AI Interaction Profiles in Engineering Design Education
- The Mediated Moon: Semantic Mediation Between Gesture and Generative Image


AHFE Open Access