An Entrustment-Based Human Factors Framework for Integrating Artificial Intelligence into Healthcare and Medical Education

Open Access
Article
Conference Proceedings
Authors: Bryan Johnston, Scott Adams, Kiven Erique Lukong, Jay Kalra
Abstract

Artificial intelligence (AI) is increasingly transforming medical education and clinical practice through image interpretation, risk prediction, diagnostic decision support, and automated documentation. As learners encounter these technologies, medical education must prepare them not only to understand and use AI, but also to critically evaluate when to trust, question, or override AI outputs. Existing approaches to AI education commonly emphasize digital literacy, technical understanding, and ethical use, yet provide limited guidance regarding how supervisors should determine whether a learner can use AI responsibly with increasing independence. This work proposes an entrustment-based human factors framework for integrating AI into healthcare and medical education. The framework brings together three elements: human factors principles, which emphasize the interaction among clinicians, learners, technologies, tasks, teams, and clinical environments; the patient-centered CARES framework (Communication, Autonomy, Respect, Equity, and Safety) which defines the responsibilities that should guide AI-supported care; and entrustment, which links these responsibilities to observable learner behaviors, supervision decisions, and progressive independence. Within this framework, Communication requires clinicians to explain the role, limitations, and uncertainty of AI-supported decisions. Autonomy requires preservation of meaningful patient and clinician choice. Respect includes attention to privacy, dignity, and individual context. Equity requires recognition of biased or poorly generalizable performance. Safety requires active monitoring, appropriate human oversight, and thus the prevention of harm. We have observed that AI introduces a second-order entrustment challenge into medical education. Supervisors must determine not only when learners can be trusted to perform a clinical task, but whether they can be trusted to judge when, why, and to what extent an AI-enabled system should itself be trusted. This requires a metacognitive capacity for trust calibration. Learners must recognize the limitations of both human and algorithmic judgment, communicate uncertainty, and seek guidance when the limits of safe independent action are reached. As learners progress toward independent practice, they increasingly assume a learner-supervisor role in which they are responsible for overseeing the contribution of AI to patient care. Within this framework, entrustment decisions can help supervisors determine when learners are ready for greater independence in using AI-supported tools while maintaining appropriate human oversight, continuous learning, and patient safety. We recommend integrating CARES-informed competencies into entrustment decisions in order to provide a practical foundation for curriculum development, assessment, and the safe incorporation of AI into healthcare and medical education.

Keywords: Artificial Intelligence, Human Factors, Entrustment, Patient Safety, Medical Education, Quality Care

DOI: 10.54941/ahfe1008436

Cite this paper
Downloads
0
Visits
1
Download PDF

More from this volume

← Reducing Nursing Communication Burden Through a Digital Health Passport Platform: A Patient-Centered UX Design ApproachConoCancer: A RAG-Based Chatbot for Breast Cancer Health Literacy →
View all articles in Human Factors in Design, Engineering, and Computing →