A Design Methodology for Explainable Supervisory Interfaces Supporting Situation Awareness and Human-AI Collaboration in Augmented SOCs
Abstract
The increasing integration of Artificial Intelligence (AI) agents into monitoring environments, such as Security Operations Centers (SOCs), is significantly transforming analysis, decision-making, and incident response activities. While these agents allow the automation of certain processes, they also raise new challenges regarding transparency, oversight, and human–AI coordination. Operators must be able to understand the status and behavior of AI agents, oversee their actions, adjust task delegation, and maintain awareness of their own ability to intervene. In this paper, we propose a methodology to design an explainable monitoring dashboard intended to support interaction between a human operator and a set of AI agents. The design principles are based on the concepts of Situation Awareness and Human-AI Teaming, as well as recommendations from research in Human-AI Interaction. The methodology is applied to the context of augmented SOC where an analyst monitors and analyzes security events in real time to identify potential threats, assess alerts, and determine appropriate responses. More specifically, the dashboard is structured around four complementary dimensions: (i) visualizing the operational status of the AI agents, (ii) maintaining a shared understanding of the collaborative activity between humans and the agents, (iii) supporting adjustable task delegation through supervision and reallocation mechanisms, and (iv) taking into account the operator’s cognitive and operational state. This approach leads to the definition of an interface that incorporates mechanisms for transparency, explainability, and human control, aimed at improving understanding of AI agents’ behavior while keeping the operator at the center of the decision-making loop
Keywords: Human-AI Interaction, Situation Awareness, Explainable AI, Security Operations Center, Supervision Dashboard, Human-AI Teaming, Adaptive Delegation
DOI: 10.54941/ahfe1008270
Cite this paper
More from this volume
- AI-Enhanced Live-Streamed English Language Learning: Designing and Evaluating an Intelligent Platform for Chinese Learners
- "They Will Move": Confirmation Bias, Expectation Frames, and Premature Monitoring Drop Off in COLREG Encounters
- Automation transparency communication does not improve supervisory control performance, but shapes operator trust
- The influence of neuroticism on startle and surprise response: a flight simulator study
- EEG-Based Classification of Reward, Penalty, and Movement Events Across Four Video Games of Varying Complexity
- The Effects of Task Similarity and Time Pressure on Task Performance Following Interruptions in Complex Human-Computer Interaction Systems
- Trusting the Chain, Not the Black Box: A Provenance-Based Architecture for Human-Machine Teaming in Military Autonomy
- Design of a Simplified Humanoid Robot Face: Cultural Differences and Emotional Synchronization
- From Visual Observation to Auditory Interaction: A Human-Centered Tangible Music System Based on Physical Objects
- The Impact of Scarcity-Based Dark Patterns on User Performance, Perceived Darkness, and Workload in Subscription Services
- A Behavioral Observation Tool for Diagnosing Human–AI Interaction Profiles in Engineering Design Education
- The Mediated Moon: Semantic Mediation Between Gesture and Generative Image


AHFE Open Access