Healthcare System Focusing on Emotional Aspect Using Augmented Reality: Emotion Detection by Facial Expression

Abstract

Current research includes many proposals of systems that provide assistances and services to people in the healthcare fields; however, these systems emphasize the support physical rather than emotional aspects. Emotional health is as important as physical health. Negative emotional health can lead to social or mental health problems. To cope with negative emotional health in daily life, we propose a healthcare system that focuses on emotional aspects. This system provides services to improve user emotion. To improve user emotion, we need to recognize users’ current emotional state. Therefore, our system integrates emotion detection to suggest the appropriate service. This system is designed as a web-based system. While users use the system, facial expression and speech are detected and analyzed and to determine the users’ emotions. When negative emotions are detected, our system suggests that the users take a break by providing services (designed to provide relaxation, amusement and excitement services) with augmented reality and Kinect to improve their emotional state. This paper focuses on feature extraction and classification of emotion detection by facial expression recognition.

Keywords: E-Healthcare, Emotion Recognition, Facial Expression

DOI: 10.54941/ahfe100521