Marionette-Inspired Interface: Bridging Traditional Puppetry and Modern Avatar Control

Abstract

As virtual spaces evolve, avatars and robots are becoming significant proxies for human presence across various domains. However, current methods for avatar control, such as motion capture and image recognition, often involve high costs, complex setups, or limited portability. To address these challenges, this study introduces an innovative interface inspired by the manipulation techniques of traditional marionette puppetry, aimed at enhancing interpersonal communication through avatars.Marionette puppetry, which uses tools composed of a puppet and a controller, offers a unique mechanism for abstracting and simplifying human motion. By holding the controller above the puppet, the puppeteer can reproduce complex human movements using only their hands. For example, vertical controllers commonly used in regions like the Czech Republic and Germany enable a single hand to manipulate a puppet’s head and feet, simplifying intricate operations into intuitive gestures. This study focuses on this abstraction capability and adapts it to a digital interface, making avatar and robot control both graceful and user-friendly.The structure and techniques of marionette controllers vary widely depending on their cultural and regional origins. Previous studies have classified controllers into several types, such as vertical, horizontal, angled, and paddle designs, each with unique mechanisms and effects. While this research primarily explores vertical-style controllers, other styles hold potential for diverse applications in digital interfaces. By leveraging these culturally rich control mechanisms, the proposed system translates traditional artistry into cutting-edge technology, offering both simplicity and flexibility.A prototype device and simulated operation system were developed to evaluate the practicality of this concept. In user experiments, participants—including those with no prior experience—successfully operated the device, achieving results comparable to those of advanced existing systems. These findings suggest that marionette-inspired interfaces can democratize access to virtual spaces, offering intuitive and accessible tools for avatar manipulation.Despite these advantages, traditional marionette operation often requires years of practice to master, particularly for artistic expressions. To address this, we have to propose methods to reduce the learning curve while maintaining the expressive richness of traditional puppetry. Further experiments identified areas for improvement, such as enhancing responsiveness and expanding the range of possible movements. These insights will guide future iterations of the device and its associated software.Through this research, we aim to bridge the gap between traditional craftsmanship and modern technology, creating tools that are both innovative and culturally grounded. This study not only demonstrates the potential of marionette-inspired control interfaces but also highlights the broader implications of integrating traditional techniques with contemporary digital systems. The findings underscore the importance of designing intuitive and inclusive technologies that foster deeper engagement and connection in both personal and professional contexts.

Keywords: marionette, human-computer interface, avatar, robot, puppetry

DOI: 10.54941/ahfe1006624