AI-Driven Text-to-Speech for Non-Playable Characters in XR Educational Environments

Abstract

This case study explores the implementation of a text-to-speech (TTS) engine integrated with conversational artificial intelligence (AI) to create interactive non-playable characters (NPCs) for Virtual and Mixed Reality (VR/XR) educational environments. The primary objective was to design a course that introduces students to three transformative technologies—AI, Virtual Reality (VR), and Extended Reality (XR)—while encouraging them to develop AI-driven, voice-acted NPCs as educational tools. These NPCs serve as interactive agents to support the students' learning experience within immersive environments. Throughout the study, various state-of-the-art AI tools were evaluated in combination with leading game engines to determine the most effective and accessible development environment for educational purposes. The project was conducted at Ocean Center, an initiative of the Amazonas State University in Brazil, which offers free technology-focused courses to the population of the western Amazon region. Among the Center's offerings are AR, VR, and XR courses, now enhanced with AI integration to broaden students' technological skillsets. By combining conversational AI with TTS capabilities in immersive VR/XR settings, the project provides a comprehensive framework that empowers students to create engaging, intelligent virtual characters. This approach not only enhances their technical competencies but also fosters creativity and innovation. The results suggest a promising model for integrating emerging technologies into education and may serve as inspiration for educators and institutions seeking to adopt immersive, AI-enhanced learning methodologies worldwide.

Keywords: Conversational AI, Text-to-Speech, Virtual Reality, Extended Reality, Educational Technology

DOI: 10.54941/ahfe1007099