ConoCancer: A RAG-Based Chatbot for Breast Cancer Health Literacy

Open Access
Article
Conference Proceedings
Authors: Alexa Rivera, Anika Bokka, Francisco Iacobelli, Renu Balyan
Abstract

Breast cancer remains one of the most commonly diagnosed cancers among women worldwide, yet gaps in health literacy and language access continue to limit early detection and informed decision-making, particularly among low-literacy Hispanic/Latina populations. Conversational AI offers on-demand health education at scale, but general-purpose large language models deployed without grounding frequently produce fluent yet unsupported or outdated responses, a failure that is especially costly in medical contexts. A further complication is that many patients in this population communicate by code-switching between English and Spanish rather than in one language exclusively. To address these gaps, we developed a bilingual intelligent tutoring system for breast cancer education, constituting short instructional videos with interactive quizzes and a chatbot for answering foundational breast cancer questions. However, this had some limitations that are targeted in this study. This paper focuses on improving the Quiz Scoring module and the Chatbot. We replaced the existing chatbot's architecture with a Retrieval-Augmented Generation (RAG) pipeline and keyword-based quiz grading with semantic grading and natural language inference (NLI). We evaluate the performance across four language variants (English, Spanish, and code-switched variants). Generation quality is assessed with Ragas (RAG Assessment), and retrieval performance is measured against the source passage from which questions were drawn. Generation was found comparable across language variants, but retrieval was not. The Spanish and code-switched queries could retrieve the corresponding passage, but failed to rank it as first option. Semantic grading outperformed the keyword baseline for only English, while NLI outperformed both approaches for all variants.

Keywords: Retrieval-Augmented Generation, Breast Cancer Education, Health Literacy, Code-Switching

DOI: 10.54941/ahfe1008437

Cite this paper
Downloads
0
Visits
1
Download PDF

More from this volume

← An Entrustment-Based Human Factors Framework for Integrating Artificial Intelligence into Healthcare and Medical EducationUtilization of Multi-Stakeholder Visualization in Medical Management Strategy Development: A Case Study of the BSP Cardiovascular Detection Project →
View all articles in Human Factors in Design, Engineering, and Computing →