Multi-Sensory Collaboration Design Strategies for Construction Machinery Teleoperation Based on Embodied Cognition

Abstract

Aiming at the problems of lack of telepresence, low operation accuracy, and high cognitive load caused by relying solely on single visual feedback in complex and extreme environments, this study, guided by embodied cognition theory, systematically constructs a multi-sensory synergistic strategy for construction machinery teleoperation scenarios to comprehensively enhance operation precision, telepresence, and human-machine interaction efficiency. First, based on literature research on the characteristics of embodied cognition theory and multi-sensory design principles, a progressive embodied multi-sensory synergistic framework is innovatively proposed: "Embodied Multi-sensory Anchoring - Cognitive Consistency Integration - Context-Adaptive Synergy." Subsequently, guided by this synergistic framework, user research and Kano model analysis were conducted to deeply excavate operator pain points, clarify core multi-sensory needs and synergy priorities, and build a multi-sensory synergistic requirement model for this scenario. On this basis, a three-part multi-sensory synergistic design strategy system was refined: Perceptual Reconstruction, Cognitive Fusion, and Contextual Adaptation. The strategies proposed in this study provide specific ideas and practical paths for the multi-sensory synergistic optimization of future teleoperation devices, and offer more adaptive solutions for human-machine interaction innovation in the intelligent upgrading of construction machinery, assisting designers in precisely optimizing designs and enhancing the operational experience.

Keywords: Embodied Cognition, Construction Machinery Teleoperation, Multi-sensory Synergy, Kano Model

DOI: 10.54941/ahfe1008048