AHFE Open AccessAffective and Pleasurable Design
Editors: Shuichi Fukuda, Merve Mamaci
Topics: Affective and Pleasurable Design
ISBN: 978-1-964867-80-9
DOI: 10.54941/ahfe1007223
Table of Contents
An Embodied Interaction System for Five-Tone Music Therapy: A Guqin-Inspired Multimodal Design
In the fast-paced and high-pressure conditions of contemporary life, chronic stress can aggravate anxiety and depression, increasing the need for gentle, everyday, non-pharmacological ways to support mind–body regulation. Grounded in Traditional Chinese Medicine, this study translates Five-Tone Therapy linking the pentatonic scale ( gong, shang, jue, zhi, yu) with five internal organs into an operable digital, music-based healing experience. Using the guqin’s aesthetic form as the central medium, we develop an interactive therapeutic system from an embodied cognition perspective to facilitate emotional regulation.The study adopts embodied cognition theory and a design research approach using user journey mapping. Key nodes of the therapeutic process, affective rhythms, and system response logic are identified and organized into five sequential stages: entering the application, completing a mind–body assessment, receiving system-recommended therapeutic strategies, conducting self-directed therapy, and reviewing therapy records and longitudinal trends. The paper focuses on personas, namely university students, working professionals, and retired older adults, and designs based on the common pain points shared by all these groups.Based on these findings, we prototype a multimodal system comprising a guqin-inspired therapeutic speaker, a companion mobile app, and tangible props representing the five organs. After a baseline assessment, users trigger corresponding Five-Tone playback by touching a prop with a built-in photosensitive sensor, synchronizing speaker lighting with app visuals to form a multisensory feedback loop. The outcomes offer practical insights for embedding cultural elements in therapeutic product design and for leveraging embodied interaction to enhance user experience and therapeutic effectiveness.
Muzheng Zhu, Xin Xie
Open Access
Article
Conference Proceedings
Beyond Function: An Analysis of Affective Design Factors in Japanese Mechanical Watches with High Auction Prices
In research on the brand value of luxury products, product price serves as an indicator for measuring brand value. Watches that command high prices at auctions can be said to possess high value. Therefore, this study clarified the factors behind high auction prices by using brand value factors. This study is part of the research on luxury product pricing. As background, while the theory of price signaling is well known in studies on luxury product pricing, this theory posits that price signals the perceived quality of a product rather than the factors constituting product prices. Since luxury products possess value beyond function, it is natural to consider brand value as a factor influencing their prices. This study analyzes the relationship between price and brand value factors. Based on prior studies, the brand value factors used are “iconic products,” “consistency with brand identity,” and “rarity.” Due to the lack of a theoretical background, this study is primarily exploratory in nature. Japanese mechanical wristwatches were selected as the subjects of this study. Among luxury products from companies listed on the TSE, only Japanese whisky and wristwatches consistently command high prices at global auctions. Furthermore, almost all wristwatches appearing in these auctions are mechanical watches. Auction data from Phillips, one of the world’s leading auction houses, was used. Phillips’ watch-related auction sales in fiscal year 2024 were approximately $210 million in total, accounting for 41% of the watch auction market and making it the world leader in this field. The analysis sample comprised 57 Japanese mechanical wristwatches sold at Phillips since 2018. At Phillips, expert estimates serve as the pricing benchmarks. Results significantly exceeding these estimates are covered by global media and influence brand reputation. The analysis revealed that hammer prices exceeding estimates can be explained by three configurations: (1) iconic products with low production numbers, (2) iconic products featuring cases aligned with the brand’s identity, and (3) watches with low production numbers featuring cases aligned with the brand’s identity. In other words, no single factor alone determines hammer prices. Even when a specific factor is present, some hammer prices exceed the estimate while others do not. In addition, hammer prices exceeding the estimate result from multiple combinations of these factors. The academic contribution of this study is that it uses price as a metric to reveal how brand value factors—being an iconic product, possessing consistency with brand identity, and having rarity—interact to create value. Practically, the identification of price-related factors contributes not only to luxury goods but also to the manufacturing industry overall, enhancing profitability and brand value. While high secondary market prices positively impact brand value, this study found that iconic products are one of the factors that influence high prices on the secondary market, such as auctions. It also clarified the importance of product development aligned with brand identity.
Keisuke Okahara, Shinya Nagasawa
Open Access
Article
Conference Proceedings
Environment Providing Necessary Information to Users Using Multiple IoT Avatars
Recently, smartphones have enabled people to access necessary information anytime, anywhere. However, it is difficult to obtain information in situations where smartphones or GPS cannot be used. We have developed IoT avatar technology as a method to obtain information from the surrounding environment where users exist. IoT avatar is a technology that provides information to users through the conversations with objects to which IoT devices are attached. Users in the field can communicate with remote users or generative AI through the objects. In particular, in this study, a multiple IoT avatar environment was constructed in which several IoT devices work together to provide continuous information to users such as walking guidance even when users move in the field. In the experiment, subjects were guided to the destination room by switching connections to multiple IoT avatar devices. The experimental results showed that multiple IoT avatars could provide continuous guidance to subjects in the field. We also confirmed that though subjects' consciousness of communicating with each object was decreased, they perceived the same personalities of the IoT avatars and were able to obtain continuous information.
Tetsuro Ogi, Yuki Kida
Open Access
Article
Conference Proceedings
i-EyFuze: An Eye-Shaped eHMI in Autonomous Vehicles that Provides Intentions for Pedestrians
Autonomous driving technology has attracted considerable attention in recent years. Among them, eHMIs (external Human Machine Interface) that display text and symbols as a method of conveying a vehicle’s intentions have been actively developed. However, there are cases where the vehicle’s intentions are difficult to understand for pedestrians, or the differences in language and culture lead to various interpretations. Therefore, a method that enables pedestrians to intuitively understand the vehicle’s intentions is required. In our previous project, a twinkling eye interface that mimics the human eyeball was developed. In this interface, the self-shadow is superimposed to clarify the self-visualization in addition to the eye. It was demonstrated that the self-visualization supports intuitive interaction, such as paying attention and increasing interest. In this study, an Eye-Shaped eHMI called i-EyFuze was developed. i-EyFuze visualizes the vehicle’s recognition state by superimposing the pedestrian’s image onto the gaze display, thereby enhancing the communication of the vehicle’s driving intentions. In addition, the effectiveness of the developed eHMI was demonstrated by sensory evaluations through an experimental environment that simulated a pedestrian crossing.
Yoshihiro Sejima
Open Access
Article
Conference Proceedings
Voice-Based Human Relaxation Assessment Using Autoencoder-Driven Anomaly Detection of Calm Speech
Speech contains paralinguistic cues that reflect psychophysiological states, making it a promising non-contact signal for monitoring mental well-being. However, supervised stress prediction is often impractical because high-stress utterances are difficult to collect at scale, ethically sensitive, and typically weakly labeled. Additionally, real-world datasets frequently exhibit substantial cohort imbalance and repeated measurements per participant. Therefore, we propose a relaxation-first one-class screening approach. Using speech data collected in Tamura City, Fukushima Prefecture, Japan, we first computed a calm score for each recording using an in-house logistic regression-based emotion estimator. We then validated Tamura as a practical relaxed reference cohort through a participant-aware comparison procedure, employing cluster bootstrapping with matched downsampling of an external cohort. The Tamura cohort exhibited a higher mean calm score than the non-Tamura cohort (mean difference = 10.43; Hedges’ g = 0.34; Welch t-test p = 2.5×10⁻⁹), along with a higher rate of “high-calm” samples under a stringent upper-tail criterion (calm ≥ 95.0). Uncertainty was quantified using bootstrap confidence intervals. Using Tamura as the reference distribution for normal data, we trained a denoising autoencoder on standardized 128-dimensional log-Mel summary features, defining the anomaly score as the reconstruction error. The decision threshold (τ= 0.6484) was calibrated by controlling the false-positive rate on normal validation data. The model demonstrated stable convergence (final loss ≈ 0.36) and produced interpretable, deployment-ready outputs: near-threshold normal samples remained below τ (e.g., 0.6338), whereas clear anomalies exceeded it (e.g., 1.016). Overall, this study presents a coherent pipeline linking data constraints, imbalance-aware validation, and autoencoder-based deviation detection, offering a practical approach to low-burden, voice-based relaxation screening. However, we emphasize that “calm” is a model-derived proxy and requires further validation against human-grounded assessments.
Kanji Okazaki, Keiichi Watanuki
Open Access
Article
Conference Proceedings
Feasibility study of estimating visuospatial cognition and mental states using eye movement and brain activity during domain-specific tasks
Visual cognitive abilities contribute to learning and occupational performance. However, individuals with high cognitive abilities do not necessarily exhibit adaptive psychological functioning. Building on our previous findings (Matsushima et al., 2025), this study examined the differences in arousal–performance relationships and psychosocial adaptation across four visual cognitive domains: visual spatial cognition, visual linguistic processing, visual working memory, and visual attentional control. Physiological indices (pupil diameter, near infrared spectroscopy activity, and autonomic measures) and psychological indicators (stress responses, emotion regulation, and resilience) were assessed. Participants in the high visual spatial cognition group exhibited heightened physiological arousal, including pupil dilation and increased right dorsolateral prefrontal cortex activation, accompanied by elevated stress responses and reduced cognitive reappraisal, indicating a profile characterized by high performance and a substantial psychological load. In contrast, the high visual attentional control group showed an adaptive profile characterized by parasympathetic dominance, effective emotion regulation, and greater resilience, demonstrating that cognitive strength does not uniformly predict psychological adaptation and that arousal patterns differ qualitatively across cognitive domains. Domain-specific assessments integrating physiological arousal and psychosocial adaptation may facilitate the early identification of individuals with high cognitive ability who are susceptible to psychological difficulties and provide a foundation for domain-specific screening and early preventive intervention.
Masami Matsushima, Shunpei Kiuchi, Keiichi Watanuki
Open Access
Article
Conference Proceedings
Deep Learning of Latent Gaze Representations for Cognitive Ability and Mental State Estimation
This paper proposes a novel pipeline for estimating individual cognitive processing ability from eye-tracking data using the latent representations of a deep-learning model trained to predict trial-level correctness during problem-solving. Ten undergraduate participants completed four cognitive tasks: reading comprehension, visuospatial reasoning, memory recall, and focused attention. Binocular gaze data were recorded using a Tobii Pro eye-tracking device. A Transformer-based sequence model, optimized via a 200-trial Bayesian search using the silhouette score of the resulting latent space as the objective, was trained to classify each 100-timestep gaze sequence as correct or incorrect. The optimal architecture achieved a validation accuracy of 0.725 and produced a 32-dimensional latent representation per trial. Univariate logistic regression identified the three most cognitively informative latent dimensions (z_0028, z_0022, and z_0031), each achieving a classification accuracy of 0.700–0.712 independently. Within the resulting 3D subspace, the per-participant centroids of correct- and incorrect-trial embeddings exhibited consistent directional displacement along the primary cognitive axis, providing an interpretable subject-level index of the cognitive processing ability without any external standardized assessment. A supplementary longitudinal experiment further demonstrated that the session-level centroid shifted substantially toward and beyond the correct-trial region following a task-specific training intervention in a single participant, suggesting that the proposed representation is sensitive to training-induced cognitive changes. Although the latent space exhibited weak global cluster separation and the training experiment remains preliminary, these findings support the viability of gaze-based latent centroid tracking as a non-invasive biomarker for both static cognitive profiling and longitudinal cognitive change detection.
Shunpei Kiuchi, Masami Matsushima, Keiichi Watanuki
Open Access
Article
Conference Proceedings
Lightweight Driver Drowsiness Detection Model Using MediaPipe Blendshapes and a Dual-Attention Hierarchical BiLSTM
Driver drowsiness contributes to approximately 10%–20% of global road accidents. Camera-based fatigue detection systems usually require a tradeoff: simple models using geometric thresholds often miss subtle early signs of sleepiness, whereas deep-learning models with higher accuracy rely on computationally heavy raw-pixel processing. This paper presents a lightweight and computationally efficient alternative for real-time edge devices. Instead of processing raw video frames, the proposed system utilizes the Google MediaPipe Face Landmarker to extract a streamlined vector of facial blendshape coefficients. These kinematics were processed using a dual-attention hierarchical bidirectional long short-term memory network. To capture both quick blink events and gradual fatigue over time, the model analyzes 3,600-frame (2 min) video segments using a sliding window approach that evaluates localized 50-frame (1.6 s) microchunks with a 25-frame stride. During training, rather than forcing fatigue into a strict binary classification, this architecture models drowsiness as a continuous progression using soft target probabilities. This allows the network to evaluate the gradual temporal patterns of early-onset fatigue, such as changes in blink behavior over time. This approach allowed the system to be successfully generalized across different individuals in the dataset. Evaluated on the unfiltered UTA-RLDD dataset using an early detection threshold of 0.35, the model achieved a window-level accuracy of 86.90%, a video-level accuracy of 88.89%, and a critical safety window-level sensitivity of 91.14%. Finally, this paper proposes a hardware architecture for a closed-loop haptic mitigation seat and establishes a foundation for future simulator-based validation studies.
Suhas Mangalesh Chavan, Kazunori Kaede, Keiichi Watanuki
Open Access
Article
Conference Proceedings
Estimating 3D Ground Reaction Forces During Gait Using a Deep Learning Model with IMU and Plantar Pressure Data
Approximately 40% of the long-term care requirements of the elderly are related to their declining walking ability, making early detection crucial. However, conventional ground reaction force (GRF) measurements are limited to laboratory environments, making daily measurements difficult. In this paper, we propose a method for estimating three-dimensional GRFs using deep learning with plantar pressure sensor and inertial measurement unit (IMU) data obtained from shoe-type devices. Gait data (13,542 strides) were collected from 12 healthy males (23.5 ± 1.2 years) under three speed conditions, and three models (1D-convolutional neural network, bidirectional long short-term memory, transformer) were compared. The transformer model achieved the highest estimation accuracy (average normalized root mean square error: 5.91%; average mean absolute error: 2.92%; body weight: average R²: 0.842). Furthermore, the introduction of a weighted loss function improved the overall accuracy, and we confirmed that the IMU data improved the estimation accuracy of the horizontal components (Fx, Fy). This method enables the continuous monitoring of walking ability in daily living environments.
Hideyuki Nagashio, Yusuke Osawa, Keiichi Watanuki
Open Access
Article
Conference Proceedings
Integrating SOR and TAM Models to Explore Consumer Emotions and Preferences in Fur Fashion Design
This research examines how design perception, emotional experience, and technology acceptance jointly influence consumer preferences for fur and faux-fur clothing. By proposing an integrated SOR-TAM framework combining the Stimulus-Organism-Response (SOR) model and the Technology Acceptance Model (TAM), the study explains consumer attitudes toward fur clothing. Cultural-Aesthetic Value (CAV), Emotional-Experience Value (EEV), Functional-Applicability Value (FAV), and Innovative-Sensory Value (ISV) are defined as stimulus factors influencing Consumer Satisfaction (CS), which subsequently affects Purchase Intention (PI). Perceived Usefulness (PU) and Perceived Ease of Understanding (PEOU) are supplementary factors that affects Consumer Satisfaction and Purchase Intention. 11 hypotheses were made for further verification. A questionnaire was used to collect data, which were developed based on the SOR-TAM framework. 469 valid responses were analyzed using AMOS 25.0. The results showed that FAV has the strongest effect on consumer satisfaction, followed by CAV and EEV, while ISV has a weaker influence. Consumer satisfaction mediates the relationship between product perception and purchase intention. In addition, PEOU positively affects PU, which further strengthens this relationship. This study extends the SOR-TAM framework to fur clothing research and proposes design strategies integrating function, culture, and experience, offering insights for enhancing consumer satisfaction and supporting the cultural continuity of fur clothing design.
Sijia Wen, Wei Ding
Open Access
Article
Conference Proceedings
Effect of Changing Task Sequence on Physical Workload in Agricultural Operations
To improve work efficiency and reduce the risk of injury in agriculture, this study focused on altering the task sequence to reduce physical workload. Based on typical agricultural activities, three types of tasks were designed to involve different body parts and movement characteristics (lifting heavy objects, repetitive light work in a forward-bending posture, and holding heavy objects with one hand). The impact of different task sequences on physical movements was evaluated using the joint angles and center of pressure (COP) displacement measured during the lifting task. Body movement data were collected from 12 healthy participants (23.1±1.3 years old) using a motion capture system and force plates across six experimental protocols with different task sequences. The statistical analyses of the knee joint angle, hip joint angle, and COP displacement revealed no significant differences among the six protocols. The mean knee joint angle was approximately 100°, with a relatively high interparticipant variability. The hip joint angles ranged from approximately 138° to 144°, with slightly lower mean values observed when the protocol began with holding a heavy object with one hand. The average COP displacement was approximately 34 mm across all the protocols, although a slightly greater interparticipant variability was observed when repetitive forward-bending movements were performed in the initial phase. These results suggest that the joint angles and COP displacement obtained from a representative task may be useful indicators for evaluating the physical workload in multitask agricultural operations.
Soei Obara, Yusuke Osawa, Kazunori Kaede, Keiichi Watanuki
Open Access
Article
Conference Proceedings
Influence of Social Appearance Attributes of Cyber Driving Support Agents on the Passenger Effect
The “passenger effect,” where a passenger’s presence influences a driver’s behavior, has been observed with human passengers and cyber driving support agents. However, it remains unclear exactly how the passenger effect manifests in relation to passengers’ social appearance attributes, such as age and gender. This study aimed to investigate the influence of an agent’s social appearance attributes on the passenger effect. The experiment was conducted in a virtual driving environment with six types of agents with varying social appearance attributes, such as age and gender. We collected the impression ratings of the agent and passenger ratings as evaluation metrics, and electrocardiogram data were acquired as physiological response indicators. From the electrocardiogram data, we calculated the heart rate, heart rate variability index (RMSSD; root mean square of successive differences), high-frequency components (HF), and the ratio of low-frequency to high-frequency components. The results showed a positive correlation between the driver’s sense of responsibility toward the agent and the frequency of contact with the agent, indicating that a higher frequency of contact leads to a greater sense of responsibility. This is because a stronger awareness of the agent’s presence enhances the sense of responsibility. Furthermore, as a positive correlation was observed between the sense of responsibility and both RMSSD and HF, an increase in the sense of responsibility is anticipated to lead to greater psychological stability. This is thought to be because agents that foster a sense of responsibility enhance the driver’s self-esteem, thereby reducing stress. Thus, it can be inferred that recognizing the presence of an agent leads to psychological stability.
Shinada Nachi, Kazunori Kaede, Keiichi Watanuki
Open Access
Article
Conference Proceedings
Design of a Community-Based Digital Platform for Standardized Stray Cat Rescue Based on Service System Design
Current urban stray cat rescue is hindered by fragmented processes, inconsistent Trap-Neuter-Return (TNR) standards, and financial pressures among diverse stakeholders. This "intention–action" gap prevents individual goodwill from becoming sustainable intervention. To address this, this study identifies four key user dimensions through a survey of potential volunteers: economic capacity, rescue experience, knowledge, and intention. Based on these findings, a tiered participation framework was developed using a capability-matching logic. This framework allows users to transition from observers to certified rescuers, aligning responsibilities with personal preparedness. To operationalize this, a community-based digital platform was designed for semi-enclosed settings like campuses and residential areas. Centered on the TNR lifecycle, the system integrates several key service modules: digital case registration for process tracking, transparent donation visualization to build trust, AI-assisted veterinary consultation for capacity building, and a "cloud adoption" model to sustain engagement. User clustering further refined the design decisions for interaction and service touchpoints. By converting individual goodwill into structured, traceable, and collaborative actions, this research demonstrates how human-centered digital systems can support localized animal welfare governance. The study concludes by discussing challenges in collaborative governance and diversified funding, proposing a design-driven model to activate community participation and standardize rescue practices.
Weilin Ye
Open Access
Article
Conference Proceedings
Generative AI-Enabled Innovative Design for Cultural Heritage: A Research Framework for Cultural Creative Products Based on Yingxian Wooden Pagoda
The rapid development of generative AI technology offers new opportunities for the traditional cultural and creative industry to break through homogenization. The Wooden Pagoda in Ying County, Shanxi Province, is the tallest and oldest existing wooden-structured pagoda in China, boasting extremely high cultural value. However, the corresponding cultural and creative designs for it are plagued by such problems as superficial cultural transformation, insufficient personalization and weak interactive experience. Taking the design of cultural and creative products for the Ying County Wooden Pagoda as a case study, this research constructs an AI-driven design framework for cultural and creative products, provides effective application paths, and improves the collaborative efficiency between designers and AI. Combining the AI design logic with the theories of cultural and creative design, and integrating AI generation into the general design process of cultural and creative products, this research builds a four-stage framework of "intelligent extraction of cultural elements - dynamic mapping of user demands - generation of emotional design schemes - human-machine collaborative optimization". Under the guidance of this framework, the cultural and creative products of the Ying County Wooden Pagoda designed in this research have won high praise from experts and users, which verifies the effectiveness of the framework.
Hao Ren, Lei Zhong
Open Access
Article
Conference Proceedings
Multisensory Interactive Conceptual Design for Nanyin Art Based Cultural Healing via Human-AI Collaboration
This research proposes an innovative method to transmit Nanyin culture by combining human-AI collaboration with multisensory interactive technology. Applying a combination of literature reviews, a formative pilot survey, and case analyses, this study establishes a theoretical approach for integrating traditional culture with modern art-based healing. The pilot survey examined public emotional needs and analyzed successful cases to identify the key elements of multisensory interactive design. The specific conceptual design process proceeded as follows: it begins with data collection and the extraction of cultural symbols, combining human insight with AI to recognize traditional Nanyin elements. ChatGPT and other generative tools were subsequently used to generate prompts for storyboard development. Using extracted audio features and traditional visual symbols as core inputs, AI technologies including Generative Adversarial Networks (GANs) were applied to create the image and audio materials for the exhibition. Human designers further refined the AI-generated materials to maintain stylistic consistency and ensure smooth animation transitions. This study establishes a comprehensive conceptual design path and a corresponding virtual exhibition prototype, offering new models for sharing intangible cultural heritage and using it therapeutically today.
Zhiyu Zhao, Siqi Sheng
Open Access
Article
Conference Proceedings
From Memory to Medium: Investigating How Generative AI–Based Dream Recreation Supports Emotional Restoration and Self-Continuity
In the digital age, young individuals face both emotional stress and fragmented self-narratives. Positive dreams may contain clues for repairing self-identity and enhancing life continuity, yet their fleeting nature makes them difficult to integrate. Current technological solutions fail to effectively support users in visually reconstructing meaning from dreams.This study proposes the Narrative Self-Integration (NSI) framework, using generative AI to guide users from passive recorders to active self-narrative editors. Developed through qualitative interviews (N=16) and validated through an experimental study (N=17), the framework demonstrates significant enhancement of positive emotions and sense of self-continuity.Theoretically, this work repositions generative AI as a constructive tool for self-narrative coherence. Practically, it provides a concrete pathway for next-generation digital mental health interventions.
Hongjia Lin
Open Access
Article
Conference Proceedings
Effects of Virtual Reality–Based Speech Practice on Psychological States and Performance
Many individuals experience anxiety while delivering a speech. One therapeutic approach for mitigating such anxiety is exposure therapy, in which individuals are gradually exposed to anxiety-inducing situations of increasing intensity. A psychological intervention known as Virtual Reality Exposure Therapy (VRET) has been developed in recent years. VRET enables simulated exposure therapy by constructing anxiety-provoking environments within a virtual space and having the participants wear a head-mounted display. Prior studies targeting speech anxiety have used virtual reality (VR) speech venues in which the audience’s attitude and size were manipulated to vary the level of perceived anxiety. This study aimed to determine the most effective repetition pattern of practice and to propose a more effective method for VR-based speech training. In the experiment, we established three anxiety levels for the VR speech venue. Participants then participated in VR speech practice sessions in which their anxiety levels were manipulated. The participants were divided into four groups: groups that repeatedly practiced at Level 1, Level 2, and Level 3 and a group that practiced with gradually increasing levels from 1 to 3. Before and after the VR practice sessions, the participants delivered face-to-face speeches to evaluate changes in performance. For face-to-face speeches, both self-evaluations by the speakers and external evaluations by audience members (experimental assistants) were collected. In this experiment, changes in the pattern of practice repetition did not have a substantial effect on the psychological state or performance. As opposed to the specific pattern of repetition, repeated practice itself and the resulting habituation may contribute to reductions in nervousness and anxiety as well as improvements in subjective performance evaluations.
Itsuki Kubota, Kazunori Kaede, Keiichi Watanuki
Open Access
Article
Conference Proceedings
A Data-Driven Method for Cross-Regional User Insight
In the context of globalization, products and services are increasingly designed for users from diverse cultural backgrounds. How to generate user insights that are both interpretable and translatable across different social structures, cultural psychologies, and institutional environments has become a central methodological challenge in cross-regional user research. Existing studies often exhibit a disconnection between macro-level national or contextual analysis and micro-level user experience insights: macro analyses are difficult to translate into concrete design decisions, while experience-based data analysis frequently lacks systematic interpretation within institutional and cultural contexts.To address this gap, this paper proposes a data-driven method for cross-regional user insight based on the integration of multi-source data and a layered analytical framework. The proposed method consists of three interrelated layers. At the practical layer, macro statistical data and social event frequency analysis are used to quantitatively examine material environments and survival constraints across regions. At the theoretical layer, natural language processing (NLP) techniques are applied to user-generated content to analyze emotional tendencies and value semantics, revealing culturally embedded psychological perceptions. At the strategic layer, the AEIOU framework is employed to structurally analyze everyday practices and infer broader lifestyle paradigms and institutional influences from the bottom up.Triangulation is introduced as the core analytical strategy to independently encode and cross-validate findings across the three layers, enabling the identification of cross-regionally consistent core needs as well as potential design opportunities exposed by structural differences. The concept of “comfort” is used as an application context to demonstrate the feasibility of the proposed method. The results indicate that this approach enhances both the explanatory depth and application stability of cross-regional user insights, providing methodological support for user research and decision translation in global design practices.
Shiqi Yao, Danhua Zhao
Open Access
Article
Conference Proceedings
Innovation Pathways in Cultural and Creative Product Design:An Emotional Design Perspective Based on the Palace Museum
In the context of global cultural consumption upgrading and the rise of the emotional economy, traditional museum cultural and creative products face growing challenges in engaging contemporary audiences. Current academic research predominantly emphasizes the visual translation of cultural symbols, yet remains insufficiently attentive to users’deeper emotional engagement and affective connections. To address this issue, a strategic shift toward "emotional empowerment" has become essential. This study draws upon Donald Norman’s three-level theory of emotional design and adopts the Palace Museum’s cultural and creative products as a representative case study. It investigates how strategic design interventions facilitate users’ emotional progression—from initial sensory experience to sustained cultural identification. The study proposes an integrated emotional design framework structured across three interrelated levels: instinctive, behavioral, and reflective. At the instinctive level, visual appeal is enhanced through contemporary reinterpretation of traditional motifs; at the behavioral level, usability and interactive engagement are strengthened to support functional satisfaction; and at the reflective level, cultural metaphors and narrative depth are leveraged to cultivate users’ sense of belonging and cultural resonance. Collectively, this framework establishes a coherent, sequential pathway：“visual attraction—deepened experiential engagement—spiritual resonance”，thereby offering systematic, theory-informed design guidance for museum cultural products to evolve from object-centered storytelling toward meaningful, emotionally grounded user connections.
Yuequn zhang, Xiaotong Wu
Open Access
Article
Conference Proceedings
Traditional Brand Image Activation Design Strategies Based on Narrative Theory
China's brand image design has gradually moved beyond traditional retro and homogenized approaches, focusing instead on exploring cultural depth and innovative expression. Narrative design as a key methodology for brand image upgrading, provides a theoretical framework for cultural translation and emotional connection to facilitate brand rejuvenation. This study aims to explore the application pathways and methods of narrative design theory in brand image development. Through literature review, we systematically analyzed the theoretical framework of narrative design and current trends in brand image evolution. A comprehensive review of research papers published over the past decade with keywords "narrative design" and "brand image" yielded 4,045 articles, from which twenty articles were selected for detailed analysis via correlation analysis. We propose an innovative narrative-based brand image revitalization framework comprising a three-dimensional narrative system of theme-structure-expression. Four core strategies-cultural anchoring, visual symbolization, omnichannel narrative communication, and narrative structure visualization-are introduced, supported by three design principles: cultural authenticity, consistency, and emotional resonance. The essence of narrative design lies in transforming brand assets into perceptible cultural narratives that seamlessly integrate traditional elements with contemporary aesthetics. This framework not only opens new perspectives for brand image design but also provides methodological support for revitalizing traditional brands beyond functionalism. The proposed strategies activate cultural memory through narratives rooted in brand DNA, establish emotional connections with consumer groups, and offer theoretical references and practical insights for brands to achieve image renewal and cultural heritage preservation through narrative design.
Li Yishan, Lei Zhong
Open Access
Article
Conference Proceedings
Effect of Adding Scent Stimuli on Commercial Videos to Enhance Memory
Olfactory stimuli are strongly linked to human memory. This paper examines the effects of very short scent stimuli on video advertisements to make audiences remember products. We especially focused on effect of semantic consistency (or inconsistency) between product and scent, and we observed trends of their effects over three weeks. Forty-six university students viewed four fictional beverage commercials (10 seconds each). Four conditions were tested: 1) scent matched to product, 2) mismatched scent, 3) rosemary, and 4) an odorless control. Memory of products was assessed using recognition tests one week and three weeks later. After one week, only the matched scent condition significantly enhanced memory compared to the control, highlighting the importance of semantic consistency for short-term retention. After three weeks, all scent conditions showed higher memory scores than the control, suggesting that olfactory stimulation functions as a contextual retrieval cue over time. Interestingly, the scent inconsistently matched to product got better memory result in three weeks later, implying that its incongruity or novelty may enhance cognitive engagement. These findings indicate that very short olfactory stimuli influence memory differently depending on retention stage and offer practical implications for multisensory advertising design.
Konoka Tamaru, Takashi Sakamoto, Toru nakata, Toshikazu Kato
Open Access
Article
Conference Proceedings
Designing for Emotional Resonance: Affective Communication in Cultural Heritage Interfaces
There are many digital mental health tools with little or no regard for context and time when it comes to emotional regulation and intervening in social anxiety episodes. Most existing apps provide general reminders as if all users are prepared to help themselves at any given time. Therefore, this paper outlines a design opportunity for developing micro-interventions that can provide timely assistance to people who may experience social anxiety episodes. It also looks into whether low-fidelity digital interventions could minimise immediate emotional responses while allowing users to maintain their autonomy. The research examines the COM-B model and the Fogg Behaviour Model to determine the efficacy of micro-interventions and follows on from literature reviews, stakeholder workshops, prototype development, and usability studies. In total, the ultimate aim of the project is to produce emotionally intelligent and context-aware digital interventions to assist in regulating emotions and supporting young adults with social anxiety.
Amic G. Ho
Open Access
Article
Conference Proceedings
An Intelligent Smart Mirror Framework for Real-Time Emotion Awareness and LLM-Based Reflective Guidance
Recognizing and interpreting emotional states in real time remains a challenge for individuals seeking to improve psychological resilience and emotional self-awareness. This paper presents Istibtan, a human-centered mobile framework designed to support reflective emotional awareness through real-time facial expression recognition (FER) and personalized feedback.The system employs a Convolutional Neural Network (CNN) trained on the FER-2013 dataset, augmented with facial landmark detection to enhance robustness under varying environmental conditions. Beyond emotion classification, Istibtan distinguishes itself through the integration of large language models (Gemini LLMs), which transform raw affective data into context-aware, psychology-informed reflective guidance, supporting meaningful user interpretation rather than passive monitoring.Developed using the Flutter SDK with secure cloud-based data management, the application further supports sustained emotional engagement through digital journaling and longitudinal emotion tracking modules. Evaluation on external validation datasets achieved a classification accuracy of 76.86%, indicating reliable generalization performance.By combining affective computing, reflective interaction design, and AI-driven personalization, this work contributes a novel mobile framework for enhancing emotional intelligence and proactive mental well-being, with clear implications for human-centered mental health technologies.
Waleed Al-nuwaiser, Reema Ahmad Albrrak, Lamees Alghanem, Norah Bin Ajlan
Open Access
Article
Conference Proceedings
Mitigating Urban Emotional Alienation through Multisensory Design: A Human Factors Evaluation of an Installation-Based Intervention
High-density urbanization often prioritizes efficiency at the expense of emotional well-being, creating homogeneous environments that lack affordances for sensory restoration and reinforce urban alienation. This study applies a human factors lens to the problem of affective ergonomics, examining how multisensory cues can be embedded within existing infrastructure to mitigate stress and foster emotional connection. In contrast to research focused on accessing "real nature," this project investigates low-cost interventions utilizing material reuse and phased sound modulation in resource-constrained contexts. The prototype integrates three coupled mechanisms—material agency (discarded glass, plaster, and wire), sonic narrative (an industrial-to-natural transition), and spatial choreography—to structure attentional sequencing. A mixed-methods evaluation was conducted employing an in-situ exposure protocol, behavioral tracking (dwell time), and semi-structured interviews. Results reveal three key patterns: (1) participants consistently reported feeling "settled" following the auditory transition, aligning with a stress-reduction trajectory; (2) material contrasts were interpreted as "painful yet hopeful," indicating the system's capacity to support complex narrative construction beyond aesthetic preference; and (3) increased dwell time during low-arousal phases provided behavioral evidence of sustained engagement and attentional restoration. These findings inform design guidelines for multisensory urban interventions, demonstrating how phase-based sensory cues can be strategically employed to regulate affective load in dense urban environments.
Liwen Zhang
Open Access
Article
Conference Proceedings
Toward Autonomous Acquisition of Manufacturing Skills -The Importance of Awareness and Understanding of Embodied Cognition for Performance Improvement
In recent years, manufacturing industries have actively introduced IoT and AI technologies into automated and robotized production processes in order to promote labor reduction and unmanned operation. At the same time, a fundamental question arises as to whether equivalent products can be realized simply by sharing manufacturing models, data, and machinery. Design data and manufacturing models used in production are spatially and temporally discrete, and manufacturing equipment cannot achieve sufficient precision or quality merely by purchase. Consequently, fine adjustment by highly skilled and experienced engineers and technicians remains indispensable. On the other hand, there are products for which the “handmade” nature itself creates high added value. Traditional crafts, for example, derive their value from the fact that materials, manufacturing methods, tools, and product designs have remained unchanged over long periods of time. From this perspective, human skills will continue to play an extremely important role in the manufacturing domain. Based on this recognition, this study develops a methodology to support the learning of human motion skills, focusing on how learners perceive bodily movements that are critical to skill improvement, how they understand the relationship between skills and physical actions, and how such understanding can be facilitated as awareness during the learning process.
Yoshifusa Matsuura
Open Access
Article
Conference Proceedings
EmoMasque: A Virtual Jewelry Emotional Regulation System Based on Facial Emotion Recognition and Multisensory Feedback
In the current era of human-centered design, emotional design has become a crucial paradigm for enhancing user experience. A common issue in emotional design today is the singularity of emotional regulation methods, as users are unable to directly and accurately perceive their emotions or actively participate in the process of transforming their emotional states. This paper proposes EmoMasque, an interactive virtual jewelry system designed to address this gap. The system transforms abstract emotions into perceivable and adjustable visual forms, guiding users in improving their emotions autonomously. EmoMasque integrates three core modules: a real-time facial emotion recognition module based on Plutchik’s Wheel of Emotions, which captures eight basic emotions and maps them to a dynamically color-changing virtual mask; a multisensory interaction module, allowing users to select specific facial areas such as the forehead, eyes, nose, mouth, and ears to generate corresponding visual stimuli for targeted emotional regulation; and an AI-driven dialogue agent that offers personalized healing suggestions based on sensory therapy theories. the system visualizes emotional data, assisting users in actively participating in emotional health management. The system also incorporates a long-term user follow-up mechanism and an AI iterative optimization mechanism to enhance the accuracy and adaptability of the suggestions. Preliminary user tests have shown that this system significantly improves users' ability to perceive emotions and their positive emotional experiences. This research provides a practical and evidence-based framework for the intersection of emotional design and pleasurable design.
Sida Song
Open Access
Article
Conference Proceedings
Exploring Digital Support for Pet-Loss Grief: Community Narratives as Supportive Resources for Emotional Resilience
In Japan, animals such as dogs and cats kept within households have increasingly been regarded as family members and recognized as companion animals. As pets have come to share everyday living spaces with humans, emotional attachment has deepened, and experiences of pet-loss grief have become more profound. However, social recognition and sustainable frameworks for supporting such grief remain limited. This study investigates how community-mediated grief narratives function as socio-technical resources that support emotional resilience in experiences of pet loss, and explores how these functions may be extended through digital transformation. Focusing on a community-based case in Japan, the research examines memorial essays published in a temple-run newsletter that serves as an archive of shared mourning practices.A qualitative case study design was adopted, drawing on two data sources: memorial essays voluntarily contributed by bereaved pet owners and semi-structured interviews with selected authors. The data were analyzed using reflexive thematic analysis to explore how grief experiences are articulated, shared, and socially acknowledged within a communal context. The analysis identified recurring themes of loss, gratitude, continuing bonds, and meaning-making through remembrance. The mediated sharing of these narratives fosters emotional recognition and a sense of shared experience without requiring direct interpersonal interaction. Building on these findings, the study discusses implications for affective digital design, highlighting how digitally archiving and circulating grief narratives may contribute to more sustainable and accessible forms of emotional support for individuals experiencing pet loss.
Yuka Miyazawa, Osamu Yoshie
Open Access
Article
Conference Proceedings
Venting & Fidgeting Stress-Relief Toys: A Pilot Study on Positive Emotion Triggering and Stress-Relief Stability
Emotional well-being (EWB) is closely associated with physical health and daily functioning; however, economic growth and income increases do not necessarily translate into improvements in EWB. As everyday emotion regulation artifacts, stress-relief toys are widely used to support self-regulation through physical interaction, yet the emotional effects of different behavioral toy types remain insufficiently understood. This pilot study comparatively examines the emotion regulation effects of venting and fidgeting stress-relief toys, with a focus on positive emotion elicitation and stress-reduction stability. A mixed-methods approach was employed, integrating the Self-Assessment Manikin (SAM), the Product Emotion Measurement Instrument (PrEMO), subjective evaluations, and statistical analysis. Thirty-six university students evaluated six stress-relief toys (three venting-type and three fidgeting-type) using a Latin square design to control for order effects. The results reveal a clear dual contrast between the two toy types. Venting stress-relief toys are associated with stronger positive emotion elicitation and higher user preference, but their stress-reduction effectiveness is highly sensitive to design conditions. In contrast, fidgeting stress-relief toys demonstrate stable and robust stress reduction through attentional diversion, despite eliciting comparatively weaker positive emotions. Building on these findings, this study interprets the observed differences through response-focused emotion regulation mechanisms and proposes differentiated design guidelines for venting and fidgeting stress-relief toys. Given the relatively small and homogeneous sample, the findings should be interpreted as exploratory; nevertheless, the proposed guidelines offer practical human-centered design insights for balancing emotional appeal and stress-reduction stability, contributing to the scientific design of emotion-regulation products.
Junjie Zhang, Jiayu Hua, Yifan Zhang
Open Access
Article
Conference Proceedings
Collaborative System Design of Natural Landscape Art Therapy and Visual Breathing Therapy for Alleviating Working Adults' Depression
Affected by long-term work pressure, working adults suffer from a high incidence of hidden depressive emotions. Traditional psychological intervention is costly and relies on professional sites and hardware, which cannot meet their fragmented, online and low-stress healing demands. Although the restorative characteristics of natural landscape, emotional regulation logic of art therapy, and theoretical value of visual breathing mindfulness intervention have been widely recognized, a mature collaborative healing system integrating the three has not been formed, and there is still a lack of exclusive visual interaction design paradigm for working adults. Targeting at alleviating depressive emotions among working adults, this paper constructs a collaborative design system of natural landscape art therapy and visual breathing therapy. Based on digital mindfulness and slow breathing intervention theories, dynamically scaled ink wash halos are adopted as visual breathing guidance cues following the scientific rhythm of 4-second inhalation and 6-second exhalation, establishing a visual interaction mode that guides users to adjust breathing synchronously. Combined with four types of differentiated natural landscapes, artistic visual creation is implemented to form a lightweight online healing design solution without additional hardware dependence. This study clarifies the internal collaborative mechanism of natural landscape, art therapy and visual breathing guidance at the theoretical level, and completes the systematic integrated design of healing logic, visual symbols, breathing rhythm and landscape narration. It provides a low-threshold and popularizable self-healing approach for working adults, and offers theoretical support and design references for restorative landscape application, affective interaction design and digital art therapy, laying a foundation for future empirical research and practical product development.
Xiaohui Long, Buzhou Tang
Open Access
Article
Conference Proceedings
Digital UI Design for Intangible Cultural Heritage: Cultural Translation and Emotional Design in Jiayi Village, Xinjiang
Jiayi Village in Xinqu County, Aksu, Xinjiang, is a core heritage village for the ancient Kucha music culture. The craftsmanship of Uyghur musical instrument making was included in the National Intangible Cultural Heritage List in 2008, with more than one-third of households engaged in instrument production and performance, forming a mature system of folk craftsmanship inheritance. However, existing digital dissemination forms are singular and severely homogenized, failing to modernize the deep cultural core of Kucha music, instrument patterns, and the spirit of craftsmanship. Young users find it difficult to achieve genuine emotional resonance and deep cultural identification. Meanwhile, the average age of core inheritors exceeds 65 years, craftsmen lack lightweight online display channels, and tourists lack engaging online interactive pathways. There is an urgent need to meet the demands for youthful, emotional communication of traditional intangible cultural heritage. This study adopts Cultural Translation Theory as the core framework, supported by Emotional Design Theory, targeting the dual user groups of craftsmen and tourists. By systematically deconstructing the symbolic patterns, musical characteristics, and cultural essence of Jiayi Village instruments, a hierarchical intangible cultural heritage translation system is established, facilitating a complete design logic of cultural extraction, symbolic translation, emotional empowerment, and experiential implementation. Drawing on instrument patterns and the regional culture of the Western Regions, the study innovates a unique visual IP system featuring Jiayi Grandpa, transforming traditional heritage elements into youthful and lightweight visual interactive symbols. By integrating Emotional Design across the instinctual, behavioral, and reflective layers, cultural symbols are incorporated into the UI and interaction systems, effectively bridging the distance associated with traditional heritage and addressing the lack of emotional resonance, while meeting the dual needs of craftsmen for digital operation and tourists for engaging experiences. At the system design level, this study creates a digital UI system integrating cultural education, engaging interaction, craftsman operation, and cultural product dissemination, specifically addressing superficiality of heritage transmission, singular experiences, and insufficient functional adaptation. On one hand, it builds a low-threshold online platform for craftsmen, resolving practical challenges in skill demonstration and work promotion. On the other hand, it crafts immersive interactive scenarios for tourists, deepening cultural understanding and emotional identification to promote the dynamic inheritance of rural intangible cultural heritage. The dual user-layered functional design accurately matches the differentiated needs of craftsmen and tourists, enhancing user enjoyment through engaging interactions, emotional visuals, and contextual experiences. To verify the practicality, rationality, and emotional experience value of the design, specialized experiential testing and questionnaire surveys were conducted with dual user groups. Core evaluation dimensions include visual presentation, interaction fluency, cultural accuracy, emotional enjoyment, and functional adaptability, assessed through the System Usability Scale (SUS) and semi-structured interviews. Results indicate that over 85% of participants believe the design effectively enhances the interestingness and appeal of heritage content, with significant improvements in cultural cognition and emotional identification. Craftsman users reported straightforward and practical operation, while tourist users experienced a notable increase in emotional enjoyment during immersive interactions. This study validates the feasibility of integrating Cultural Translation Theory and Emotional Design Theory in rural heritage digital design, providing new ideas and practical references for the youthful, emotional dissemination of traditional intangible cultural heritage.
Yunxiang Li
Open Access
Article
Conference Proceedings