Towards continuous mental state detection in everyday settings: investigating between-subjects variations in a longitudinal study
Abstract
Maintaining mental health can be quite challenging, especially when exposed to stressful situations. In many cases, mental health problems are recognized too late to effectively intervene and prevent adverse outcomes. Recent advances in the availability and reliability of wearable technologies offer opportunities for continuously monitoring mental states, which may be used to improve a person’s mental health. Previous studies attempting to detect and predict mental states with different modalities have shown only small to moderate effect sizes. This limited success may be due to the large variability between individuals regarding e.g., ways of coping with stress or behavioral patterns associated with positive or negative feelings. A study was set up for the detection of mental states based on longitudinal wearable and contextual sensing, targeted at investigating between-subjects variations in terms of predictors of mental states and variations in how predictors relate to mental states. At the end of March 2022, 16 PhD candidates from the Netherlands started to participate in the study. Over nine months, we collected data in terms of their daily mental states (valence and arousal), continuous physiological data (Oura ring) and smartphone data (AWARE framework including GPS and smartphone usage). From the raw data, we aggregated daily values for each participant in terms of sleep, physical activity, mental states, phone usage and GPS movement. First results (six months into the study at the time of writing) indicate that almost all participants show a large variability in ratings of daily mental states, which is a prerequisite for predictive modeling. Direction, strength and standard deviations of Spearman correlations between valence, arousal and the different variables suggest that several predictors of valence and arousal are more subject dependent than others. In future analyses, we will test and compare different versions of predictive modeling to highlight the potential of wearable technologies for mental state monitoring and the personalized prediction of the development of mental problems.
Keywords: Mental State, Detection, Wearable, Monitoring, Mental Health, Longitudinal, Personalized, Sensor
DOI: 10.54941/ahfe1003013
Cite this paper
More from this volume
- Applying Smart Assistants in Express Decision for Insurance Choices
- Application of Systemic Structural Activity Theory to Web Design
- Self-Regulation Problem Solving for Sufficient Risk Reduction
- Probabilistic predictive modeling in the critical human-in-the-loop (HITL) ergonomics engineering problems
- Validity and rationality of using neuroergonomics concept in exploring worker mental issues in systemic-activity theoretical research
- The contribution of Gregory Bedny's systemic-structural activity theory to the science of activity
- Limitations on the use of eye-tracking data to understand operator awareness
- Cognitive Engineering in Training: Monitoring and Pilot-Automation Coordination in Complex Environments
- Multimodal Learnability Assessment of a Touch-based Large Area Display with Eye Tracking and Optical Brain Imaging
- Guidelines for Artificial Intelligence in Air Traffic Management: a contribution to EASA strategy
- Multimodal characterization of mental fatigue on professional drivers
- Teamwork objective assessment through neurophysiological data analysis: a preliminary multimodal data validation


AHFE Open Access