Extreme Reality (EXR) Telemetry Interfaces

Abstract: Extreme Reality (EXR) is an extended augmented reality that incorporates telemetry interfaces that can be operated in live or simulated extreme environments. In this study, we explore a few architectures of EXR, including real-time multimodal first-person view video streaming from the thermal, stereo, and panoramic sources, and incorporate live IoT (Internet of Things) data into extreme reality models via MQTT (Message Queue Telemetry Transport) on an AR headset. This technology can be applied to real-time operations and simulation training for incident command posts (ICP) and first responders with head-up display (HUD) helmets in extreme environments such as flood, fire, smoke, and shooting. It can also be applied to other applications such as the telemetry interface for assisting in training low-vision drivers.

Keywords: Telemetry, AR, Augmented Reality, Public Safety, Video Streaming, Thermal Video, Real-Time

DOI: 10.54941/ahfe1002321

Cite this paper:

​