An Information-centric and AI-based Digital Twin framework for the design of Human-Robotic Interactions (HRI) in orthopedic surgery

Abstract

This paper outlines a foundational framework to design a Cyber-Human-Physical (CHP) process for robotic orthopedic surgery. The key elements of this information centric framework include components including principles and technologies from various fields including Cyber-Physical Systems, Extended Reality and 3D Digital Twins modeling, Information driven Enterprise models, Human-Computer Interaction (HCI) / Human-Robotic Interactions (HRI) based design, Systems Engineering and Artificial Intelligence (AI). This CHP framework is cantered around the design and use of 3D Digital Twins to support cross-functional design of the overall robotic surgery framework as well as for training residents and surgeons. The creation of Information Intensive Process Models based on systems engineering methods provides a structured foundation for understanding the complexities of the surgical process and for designing the overall approach to support the cyber-human-robotic interactions. AI based tools can play a key role in automating various tasks including generation of 3D robotic path plans and to assess learning/training patterns among residents and surgeons. The 3D Digital Twins can be created using Virtual and Mixed Realty technologies to train residents and budding surgeons as well as to serve as interfaces to control the robotic surgery activities.

Keywords: 3D Digital Twins, Robotic Surgery, Artificial Intelligence, Extended Reality, Virtual Reality, Enterprise Modeling, Cyber-human-physical Environments

DOI: 10.54941/ahfe1007307