Bidirectional Human-AI/Machine Collaborative and Autonomous Teams: Risk, Trust and Safety

Abstract

We address the bidirectional challenges in developing and managing interdependence for AI/machine collaboration in autonomous human-machine teams. Recent advances surrounding Large Language Models have increased apprehension in the public and among users about the next generation of AI for collaboration and human-machine teams. The anxieties that have grown regard the risk, trust, and safety from the potential uses of AI/machines in open environments, including unknown issues that might also arise. These concerns represent major hurdles to the development of verified and validated engineered systems involving bi-directionality across the human-machine frontier. Bi-directionality is a state of interdependence. It requires understanding the design and operational consequences that machine agents may have on humans, and, interdependently, the design and operational effects that humans may have on machine agents. Current discussions on human-AI interactions focus on the impact of AI on human stakeholders; potential ways of involving humans in computational interventions (e.g., human factors; data annotation; approval for drone actions); but these discussions overlook the interdependent need for a machine to intervene for dysfunctional humans (e.g., in 2015, the copilot aboard a Germanwings airliner committed suicide, killing all aboard; in 2023, a pilot ejected from an F-35, allowing the plane to fly unguided for an additional 60 miles). Technology is advancing rapidly: Self-driving cars; drones able to fly and land autonomously; self-landing reusable rockets; Air Force loyal wingmen. The technology is available today for bi-directional AI/machine collaboration and autonomous human-machine teams to better protect human life now and in the future. Thus, despite the engineering challenges faced, we believe that the technical challenges associated with humans and AI/machines cannot be adequately addressed if the social concerns related to risk, trust and safety caused by bi-directional forces are not also taken into consideration.

Keywords: Interdependence, autonomous, human-machine teams

DOI: 10.54941/ahfe1005014