Mixed Reality Handheld Displays for Robot Control: A Comparative Study
Abstract
Robotic systems for several applications from healthcare to space explorations are being developed to handle different levels of autonomy – from working independently to working in collaboration with or under control by human operators. To ensure optimal human-robot cooperation, appropriate UIs are needed. In this context, applying Mixed Reality handheld displays (MR-HHDs), an ubiquitous tool for virtually augmenting reality, seems promising. As existing MR-HHD-UIs for robot control employ fatigue-prone and view-obstructing touch input, we propose controlling a robot arm via an enhanced MR-HHD-UI based on peripheral touch and device movement. Our detailed, comparative user study on usability and cognitive load demonstrates that the proposed MR-HHD-UI is a powerful tool for complementing the strengths of robots and humans. In our experiment, the MR-HHD-UI outperformed a Gamepad- and Desktop-UI in terms of temporal and cognitive demands and was rated as the preferred UI.
Keywords: Mixed Reality, Handheld Displays, Human-Robot Interaction
DOI: 10.54941/ahfe1005380
Cite this paper
More from this volume
- Ergonomic Adjustment Needs of Transport and Mining Machines: A Preliminary Study of Operators' Attitudes in Serbia
- Model-based Systems Engineering (MBSE) Enterprise Architecture Framework (EAF) with Human System Integration (HSI) – A Smart-City (SC) Case Study
- Model Training Through Synthetic Data Generation: Investigating the Impact on Human Physical Fatigue
- Ergonomic support for manual assembly through data-based assistance systems - challenges and solution ideas considering the legal framework conditions
- Excavators’ Cabins Ergonomic Design Influential Factors Modelling: Preliminary Study
- Dumper Operator’s Workplace Risks: Preliminary Study
- Work design in production: Foundations and recommendations for the implementation of mobile, time-flexible work design in chipping production
- Technical and Socio-Technical Success Factors of AI-Based Knowledge Management Projects
- Trusting AI: Factors Influencing Willingness of Accountability for AI-Generated Content in the Workplace
- Participatory Approaches to Design Work in the Context of Digital Transformation: An Analysis of the Needs of Employees in Public Administrations
- Hand Vibration Threshold Mapper (HaViThreMa): a Haptic Vibration System
- Enhancing Ergonomics in Construction Industry Environments: A Digital Solution with Scalable Event-Driven Architecture


AHFE Open Access