AHFE Open AccessHow should we design AI tools that handle personal information? Evaluating AI-generated personalized care advice based on deeply personal data
Abstract
AI systems typically rely on commonly available knowledge from the internet—that is, public “common sense.” However, when applying AI in personalized service domains such as healthcare and elder care, it becomes essential to incorporate deeply personal information, such as individuals’ life histories. This paper introduces a case study of an AI tool that provides personalized care advice to care workers, aiming to derive insights for designing services that focus on the individuality of each service user. We developed a prototype tool using a profile sheet constructed from real narratives. Care workers’ evaluations, analyzed qualitatively, yielded insights regarding AI usefulness, individualized care, practical applicability, advice presentation, limitations and risks, and AI use contexts.
Keywords: Generative AI, Individualized Care, Personal Information, Care Advice, Narratives, Qualitative Analysis
DOI: 10.54941/ahfe1007081
Cite this paper
More from this volume
- Artificial Intelligence Maturity Model (AIMM)
- An Experimental Study on Consensus Building with an AI Chatbot Across Two Topics
- An Agent-Based Simulation Framework for ADHD: Modeling Attention Regulation and Adaptive Therapeutic Interventions
- CRMSON: Co-Designing Adaptive and Ethical AI Systems to Address Mental Health Barriers in Aviation
- Usability Evaluation of FAIR Data Planning in the Data Stewardship Wizard
- Seeing the Invisible Load: XR + Multimodal Sensing for Cognitive Ergonomics in Industrial Training
- Conceptual Framework for Designing Domain-Specific LLM-Based Information Systems
- Shaping Conversations: Custom GPTs to Spark Reflection in Design
- Privacy at the Core: Toward Automated Detection of Privacy-Sensitive Content in an LLM-Based Care Documentation Support System
- Dynamic Difficulty Adjustment via Dynamic Scripting: An Empirical Study of Player Flow in a Brawler Game
- Sinusoidal time-based features and human error metrics: Advancing software defect prediction in safety-critical systems
- Designing an Experimental Method for Evaluating Divergent Thinking with a Color Queue under Time Constraints