Decoding the Language of Team Performance: A Machine Learning Framework for Sentiment-Based Performance Modeling and Team Situational Awareness
Abstract
This research introduces a multi-faceted AI-enabled big data sentiment analytics framework for modeling and predicting team performance in high-stakes simulation environments. Communication data from 40 teams participating in a firefighting simulation were collected. Big data and sentiment analysis techniques were used to examine communication dynamics and identify relationships among individual factors, team communication dynamics, and team situational awareness (TSA) and their collective predictors of mission success. By leveraging these insights, the proposed big data analysis framework provides a data-driven approach to enhance TSA, improve team interaction, and optimize human–machine coordination. It also supports the development of adaptive feedback systems, AI/ML model training, and improving performance prediction capabilities across diverse operational contexts. The findings highlight the potential of sentiment-based analytics to uncover subtle behavioral and cognitive indicators of team performance that traditional evaluation methods often overlook. This integration of human communication data with advanced analytics provides predictive indicators for team success and training optimization. This research advances the field of industrial and systems engineering by bridging behavioral analytics and performance modeling. It provides a systematic method for transforming unstructured team communication data into actionable insights that enhance decision-making, training, and human-AI collaboration in complex environments.
Keywords: Artificial Intelligence, Machine Learning, Human-Computer Interaction, Human Performance Modelling, Human-Machine Communications, Big Data Analytics, Human-Machine Interactions, Se
DOI: 10.54941/ahfe1008369
Cite this paper
More from this volume
- AI-Enhanced Live-Streamed English Language Learning: Designing and Evaluating an Intelligent Platform for Chinese Learners
- "They Will Move": Confirmation Bias, Expectation Frames, and Premature Monitoring Drop Off in COLREG Encounters
- Automation transparency communication does not improve supervisory control performance, but shapes operator trust
- The influence of neuroticism on startle and surprise response: a flight simulator study
- EEG-Based Classification of Reward, Penalty, and Movement Events Across Four Video Games of Varying Complexity
- The Effects of Task Similarity and Time Pressure on Task Performance Following Interruptions in Complex Human-Computer Interaction Systems
- Trusting the Chain, Not the Black Box: A Provenance-Based Architecture for Human-Machine Teaming in Military Autonomy
- Design of a Simplified Humanoid Robot Face: Cultural Differences and Emotional Synchronization
- From Visual Observation to Auditory Interaction: A Human-Centered Tangible Music System Based on Physical Objects
- The Impact of Scarcity-Based Dark Patterns on User Performance, Perceived Darkness, and Workload in Subscription Services
- A Behavioral Observation Tool for Diagnosing Human–AI Interaction Profiles in Engineering Design Education
- The Mediated Moon: Semantic Mediation Between Gesture and Generative Image


AHFE Open Access