CreteAR: Enhancing Learning Experiences through Tangible Transformable Artifacts and Extended Reality

Abstract

This paper discusses the design and development of CreteAR, a system that integrates Extended Reality (XR) with a transformable physical model of the island of Crete to enhance learning experiences. CreteAR features an XR application for handheld devices that overlays information on a scale model, which is equipped with mechatronics to elevate or conceal showcases containing culturally significant items. Users can interact with both the digital content and the physical model, activating the showcases and accessing information through a companion display. The paper explores relevant literature, analyzes similar systems, and details the design process, including user requirements and expert feedback. CreteAR was initially conceived as a prototype, but it holds the potential to contribute to the development of broader applications across various domains beyond the scope of Crete's geography and heritage. It was designed to deliver an immersive and hands-on learning experience, emphasizing social interaction and cooperative exploration, engaging users in dynamic and meaningful interactions.

Keywords: Augmented Reality, Tangible Interaction, Mechatronics, Gamification, Shape-shifting Tangible Objects, Interactive Exhibit, Digital Artifact

DOI: 10.54941/ahfe1005674