EEG-Based Classification of Reward, Penalty, and Movement Events Across Four Video Games of Varying Complexity

Open Access
Article
Conference Proceedings
Authors: Laura Martinez-Tejada, Dechathron Dasri, Yuta Yamamura, Natsue Yoshimura
Abstract

Longitudinal studies have tested video games as tools to alleviate mental health disorders such as depression and anxiety, with promising results. However, to fully assess the efficacy of video games for treating and diagnose mental health disorders, it is necessary to understand how they affect cognitive events in real time during self-paced video game interaction, and how reproducible these events are across different types of video game environments. This study characterises ERPs to three interactive mechanics: reward, penalty, and movement, across four games of increasing complexity, and tests whether the mechanics can be decoded from single-events. Seven healthy male participants played four video games of different complexity for approximately ten minutes in randomised order while 64-channel EEG was recorded. ERPs were examined over the FCz electrode and single-events were then classified with an EEGNet convolutional network across three binary tasks in cross-subject and within-subject settings. Reward events elicited a fronto-central positivity in the 200–500 ms range in every game, consistent with the reward positivity. Penalty events elicited fronto-central deflections in a comparable window but were less consistent across games. Movement events elicited a negative shift around key-press onset over fronto-central sites. All three binary classification tasks exceeded chance. Penalty versus movement was the most separable (73.3% pooled cross-subject; 81.0% best single game) and reward versus penalty the least (64.3% pooled). Within-subject models with subject-specific analysis windows performed better than cross-subject models. Both the ERP and classification results indicate that game context and individual differences shape these responses.

Keywords: Event-Related Potentials, Video Games, Reward Processing, EEGNet, Single-Trial Classification, Ecological Validity

DOI: 10.54941/ahfe1008239

Cite this paper
Downloads
0
Visits
1
Download PDF

More from this volume

← The influence of neuroticism on startle and surprise response: a flight simulator studyThe Effects of Task Similarity and Time Pressure on Task Performance Following Interruptions in Complex Human-Computer Interaction Systems →
View all articles in Human Factors in Design, Engineering, and Computing →