Multisensory Interactive Conceptual Design for Nanyin Art Based Cultural Healing via Human-AI Collaboration

Abstract

This research proposes an innovative method to transmit Nanyin culture by combining human-AI collaboration with multisensory interactive technology. Applying a combination of literature reviews, a formative pilot survey, and case analyses, this study establishes a theoretical approach for integrating traditional culture with modern art-based healing. The pilot survey examined public emotional needs and analyzed successful cases to identify the key elements of multisensory interactive design. The specific conceptual design process proceeded as follows: it begins with data collection and the extraction of cultural symbols, combining human insight with AI to recognize traditional Nanyin elements. ChatGPT and other generative tools were subsequently used to generate prompts for storyboard development. Using extracted audio features and traditional visual symbols as core inputs, AI technologies including Generative Adversarial Networks (GANs) were applied to create the image and audio materials for the exhibition. Human designers further refined the AI-generated materials to maintain stylistic consistency and ensure smooth animation transitions. This study establishes a comprehensive conceptual design path and a corresponding virtual exhibition prototype, offering new models for sharing intangible cultural heritage and using it therapeutically today.

Keywords: Nanyin Culture, human-AI Collaboration, Multisensory Interaction, Art-based Cultural Healing, Cultural Dissemination

DOI: 10.54941/ahfe1007340