EEG-Based Classification of Reward, Penalty, and Movement Events Across Four Video Games of Varying Complexity
Abstract
Longitudinal studies have tested video games as tools to alleviate mental health disorders such as depression and anxiety, with promising results. However, to fully assess the efficacy of video games for treating and diagnose mental health disorders, it is necessary to understand how they affect cognitive events in real time during self-paced video game interaction, and how reproducible these events are across different types of video game environments. This study characterises ERPs to three interactive mechanics: reward, penalty, and movement, across four games of increasing complexity, and tests whether the mechanics can be decoded from single-events. Seven healthy male participants played four video games of different complexity for approximately ten minutes in randomised order while 64-channel EEG was recorded. ERPs were examined over the FCz electrode and single-events were then classified with an EEGNet convolutional network across three binary tasks in cross-subject and within-subject settings. Reward events elicited a fronto-central positivity in the 200–500 ms range in every game, consistent with the reward positivity. Penalty events elicited fronto-central deflections in a comparable window but were less consistent across games. Movement events elicited a negative shift around key-press onset over fronto-central sites. All three binary classification tasks exceeded chance. Penalty versus movement was the most separable (73.3% pooled cross-subject; 81.0% best single game) and reward versus penalty the least (64.3% pooled). Within-subject models with subject-specific analysis windows performed better than cross-subject models. Both the ERP and classification results indicate that game context and individual differences shape these responses.
Keywords: Event-Related Potentials, Video Games, Reward Processing, EEGNet, Single-Trial Classification, Ecological Validity
DOI: 10.54941/ahfe1008239
Cite this paper
More from this volume
- AI-Enhanced Live-Streamed English Language Learning: Designing and Evaluating an Intelligent Platform for Chinese Learners
- "They Will Move": Confirmation Bias, Expectation Frames, and Premature Monitoring Drop Off in COLREG Encounters
- Automation transparency communication does not improve supervisory control performance, but shapes operator trust
- The influence of neuroticism on startle and surprise response: a flight simulator study
- The Effects of Task Similarity and Time Pressure on Task Performance Following Interruptions in Complex Human-Computer Interaction Systems
- Trusting the Chain, Not the Black Box: A Provenance-Based Architecture for Human-Machine Teaming in Military Autonomy
- Design of a Simplified Humanoid Robot Face: Cultural Differences and Emotional Synchronization
- From Visual Observation to Auditory Interaction: A Human-Centered Tangible Music System Based on Physical Objects
- The Impact of Scarcity-Based Dark Patterns on User Performance, Perceived Darkness, and Workload in Subscription Services
- A Behavioral Observation Tool for Diagnosing Human–AI Interaction Profiles in Engineering Design Education
- The Mediated Moon: Semantic Mediation Between Gesture and Generative Image
- A Sustainable Assistive Technology for Children with Visual Impairments


AHFE Open Access