Trusting the Chain, Not the Black Box: A Provenance-Based Architecture for Human-Machine Teaming in Military Autonomy

Open Access
Article
Conference Proceedings
Authors: Richard Stone, Michael Jenkins, Joseph Fernandez
Abstract

Military adoption of AI-enabled autonomy depends on more than algorithmic performance. Commanders and operators must be able to determine when an autonomous recommendation is trustworthy, when it is stale or insufficiently corroborated, who or what generated the underlying data, what authority governs the recommended action, and how the action can be audited after execution. This paper presents a human-machine teaming trust model for military autonomy based on accountable provenance rather than opaque model confidence alone. The architecture is an accountable autonomy substrate for multi-domain manned-unmanned teaming in contested environments. Signed mission records, provenance-preserving data custody, target-quality decay, corroboration-gated confirmation, and policy-bound human authorization create a shared operational record between humans and autonomous systems. Large sensor, map, and reconstruction products remain off-ledger behind signed cryptographic commitments, so a military user can inspect the chain of evidence behind a recommendation without every platform carrying exquisite sensing, navigation, or compute. The human-factors contribution is a trust-calibration framework organized around five operator questions: Can I verify the source? Was it altered? Is it current enough for the mission? Is the machine acting within authorized policy and command intent? Can I audit what happened afterward? An operator-facing trust card renders the answers. Simulation results serve as a case study: a stress test with 300 air and ground platforms showed a compact signed index governing an off-ledger data cloud roughly 600 times its size while rejecting tampered data, repairing missing fragments, and prioritizing synchronization under bandwidth limits. The approach shifts the operator's burden from trusting a black-box output to verifying an accountable chain of evidence and authority.

Keywords: Human-Machine Teaming, Trust Calibration, Military Autonomy, Data Provenance, Autonomous Systems, Decision Support

DOI: 10.54941/ahfe1008241

Cite this paper
Downloads
0
Visits
1
Download PDF

More from this volume

← The Effects of Task Similarity and Time Pressure on Task Performance Following Interruptions in Complex Human-Computer Interaction SystemsDesign of a Simplified Humanoid Robot Face: Cultural Differences and Emotional Synchronization →
View all articles in Human Factors in Design, Engineering, and Computing →