Protecting the First Responders: Improving FR situational awareness through multi-modal interfaces leveraging the ubiquitous personal smartphone

Abstract

First responders (FRs) in disaster scenarios often lack access to real-time, context-specific information, which is crucial for maintaining situational awareness. To address this issue, we introduce PathoVIEW, an innovative interface ecosystem built around a smartphone app, that leverages the ubiquitous availability of such devices for everyone and especially the localization feature for delivering context-aware alerts. PathoVIEW provides vital and relevant information local to the First Responder in a vast disaster scenario. It also includes the use of audible feedback and other technologies that could be coupled with the phone over Bluetooth such as smartwatches or a vest with vibration motors for warning the FR about situations in their proximity. The system's feedback mechanisms are designed to be adaptive, responding to the FRs' roles, their distance from potential hazards, and the nature and severity of the threats. Thus, providing a novel way to deliver information specific to the situation and location of the FR. PathoVIEW relies on a centralized common information exchange platform that addresses the challenges of sharing data across different agencies, which can be restricted by various regulations and the diversity of tools in use. By leveraging FIWARE Smart Data Models, PathoVIEW is able to function independently of the Incident Management Systems (IMS) that organizations may employ, promoting compatibility and ease of integration. In addition to active stakeholder involvement in the design and development process to ensure a relevant solution, the system was evaluated in large-scale simulated exercises in four European countries. The FR used and interacted with PathoVIEW in close conjunction with their current systems and processes. The feedback from the FR indicated that PathoVIEW was beneficial for enhancing communication, coordination, and situational awareness. The ease of use and the seamless integration in their existing context-of-use validated the user acceptance and the FR expressed a high interest in utilising the PathoVIEW system in actual disaster response situations.

Keywords: Incident Management, Situational Awareness, Multi-Modal Interfaces, Context-Aware Alerts, Human-Centered Design, Risk Mitigation, First Responder Safety

DOI: 10.54941/ahfe1005304