The Role of Safety Management Systems (SMS) in the implementation of Human - AI teaming in Aviation Ecosystem.

Open Access
Article
Conference Proceedings
Authors: Dimitrios ZiakkasEleftherios BokasDebra Henneberry
Abstract

The integration of Human–AI teaming within the aviation ecosystem represents a transformative evolution in safety-critical operations, demanding robust organisational frameworks capable of managing emerging risks, validating new operational concepts, and sustaining human performance. As artificial intelligence becomes increasingly embedded in flight operations, maintenance, training, and safety analytics, the role of Safety Management Systems (SMS) becomes central to ensuring that human–AI collaboration is introduced, monitored, and governed in a manner consistent with international safety expectations. This paper examines how contemporary SMS principles support—and in many cases must be adapted to support—the safe and effective implementation of human–AI teaming across the aviation industry.The analysis begins by framing AI integration as a socio-technical challenge that profoundly alters hazard identification, risk modelling, and safety assurance processes. AI-enabled systems introduce unique characteristics—opacity, non-determinism, continuous learning, and probabilistic behaviour—that challenge conventional safety assumptions. SMS, traditionally grounded in predictable system performance, must expand to accommodate risks arising from algorithmic drift, data quality variability, automation bias, and human–machine misalignment. The paper argues that SMS frameworks must evolve beyond compliance-driven practices to embrace dynamic, data-rich safety monitoring capable of detecting emergent patterns of human–AI interaction.The study further explores how each component of SMS—Safety Policy, Safety Risk Management, Safety Assurance, and Safety Promotion—contributes to the governance of human–AI teaming. Within Safety Policy, organisational commitments must reflect a human-centric philosophy ensuring that AI systems complement, not replace, human cognitive strengths. Safety Risk Management must incorporate new methodologies for identifying hazards associated with collaborative automation, including unintended consequences of predictive algorithms, mismatches between AI intent and pilot expectation, and reduced redundancy in single-pilot or high-automation environments. Safety Assurance processes must evolve to include continuous performance monitoring of AI agents, explainability audits, validation of training effectiveness, and mechanisms for detecting shifts in human–AI trust relationships.Safety Promotion is examined as a crucial enabler of cultural readiness. The introduction of AI into safety-critical operations requires transparent communication, cross-disciplinary literacy, and training programmes that cultivate both confidence and critical scepticism toward AI-generated outputs. Emphasis is placed on building a safety culture that encourages reporting of anomalies involving AI systems, fosters shared understanding between technical and operational personnel, and supports learning from human–AI interaction events. The Turkish Airlines, Lufthansa Group, and FAA/EASA regulatory developments are referenced as indicative of industry movement toward SMS-driven oversight of intelligent systems.The paper concludes by proposing a strengthened SMS framework tailored to human–AI teaming. This enhanced model integrates explainable AI within risk assessment processes, adopts resilience engineering principles to manage uncertainty, incorporates AI-specific safety indicators, and emphasises adaptive training frameworks aligned with CBTA/EBT approaches. The findings suggest that the long-term success of human–AI teaming in aviation will depend not solely on technological capability but on the ability of SMS to anticipate, govern, and continuously validate the evolving dynamics of human–AI collaboration.

Keywords: Safety Management Systems (SMS), human–AI Teaming, Aviation Safety, Adaptive Automation, Risk Management, Safety Assurance, Safety Culture

DOI: 10.54941/ahfe1007834

Cite this paper
Downloads
0
Visits
1
Download PDF

More from this volume

The role of workforce planning in the implementation of Human - AI Teaming in TransportationAssessing Signal Detection Performance Under Operational Fatigue in Air Traffic Controllers
View all articles in Advances in Human Factors of Transportation