A Participatory Design based Human-Centric Mixed Reality (MR) Simulator for Neonatal Needle Thoracentesis Procedures

Abstract

Neonatal needle thoracentesis (NNTP) is a delicate, life-saving procedure performed to remove excess fluid in the pleural space in newborns. Opportunities for hands-on training are limited due to the rarity of such cases and underfunded pediatric infrastructure. To address these challenges, we developed a guided mixed reality (MR) simulator that allows medical trainees to repeatedly and safely practice NNTP in a realistic, immersive environment. By leveraging our Unity application for the Meta Quest 3 and HoloLens 2 headsets, our simulator employs passthrough technology to overlay holographic instruction onto real-world mannequins while using hand tracking to capture precise finger movements required for needle insertion. The application follows a “learn, train, test” learning model inspired by established surgical pedagogy, providing immediate feedback on procedural accuracy. Using a participatory design approach, clinical experts contributed verified procedural data and iteratively reviewed simulation accuracy to ensure medical validity. Future evaluations will compare the MR simulator’s educational effectiveness against traditional mannequin-based training, focusing on accuracy, retention, and user experience. This work demonstrates the potential of mixed reality to bridge the gap between medical theory and procedural practice, offering a scalable, cost-effective solution for neonatal care training.

Keywords: Mixed, Extended and Virtual Reality, Medical Education, Human Factors Engineering, Neonatal Needle Thoracentesis, Spatial Computing

DOI: 10.54941/ahfe1006968