AHFE Open AccessUser Trust Towards an AI-assisted Healthcare Decision Support System under Varied Explanation Formats and Expert Opinions
Abstract
While Artificial Intelligence (AI) has been increasingly applied in healthcare contexts, how AI recommendations should be explained to achieve higher user trust is yet to be determined. This study was aimed to investigate users' trust towards an AI-assisted healthcare decision support system under varied explanation formats and expert opinions. Twenty participants participated in a lab-based experiment where they were asked to complete a series of dosage adjustment tasks in chronic disease care scenarios with the help of a simulated AI-assisted decision support system. Four explanation formats and three types of expert opinions were examined. Data on subjective trust, task performance and physiological measures were collected. The results showed that explanation formats had significant effects on subjective trust, task performance and skin conductance. Expert opinion had significant effects on subjective trust and task performance. There existed an interaction effect on compliance rate between explanation format and expert opinion. It appears that AI recommendations that are explained by counterfactual reasoning way and supported by medical experts are likely to achieve higher user trust. The findings can provide references for better design of explainable AI in AI-assisted healthcare contexts.
Keywords: Explainable AI, Trust, Healthcare, Explanation Format, Expert Opinion
DOI: 10.54941/ahfe1004186
Cite this paper
More from this volume
- CHAAIS: Climate-focused Human-machine teaming and Assurance in Artificial Intelligence Systems – Framework applied toward wildfire management case study
- The Evolution of AI on the Commercial Flight Deck: Finding Balance between Efficiency and Safety While Maintaining the Integrity of Operator Trust
- TAUCHI-GPT: Leveraging GPT-4 to create a Multimodal Open-Source Research AI tool
- A Survey of Beliefs and Attitudes toward Artificial Intelligence — Practical Implications and Fictional Depictions
- Exploring the Impact of Generative Artificial Intelligence on the Design Process: Opportunities, Challenges, and Insights
- Relationships among Personality Traits, ChatGPT Usage and Concept Generation in Innovation Design
- Leveraging Multi-User Dungeons for Ethical AI Decision Support Systems: A Novel Approach
- Measuring the Impact of Picture-Based Explanations on the Acceptance of an AI System for Classifying Laundry
- Automated generation of synthetic person activity data for AI models training
- Human-Animal Teaming as a Model for Human-AI-Robot Teaming: Advantages and Challenges
- A method to generate adversarial examples based on color variety of adjacent pixels
- Integrating Domain Expertise and Artificial Intelligence for Effective Supply Chain Management Planning Tasks: A Collaborative Approach