Decoding the Language of Team Performance: A Machine Learning Framework for Sentiment-Based Performance Modeling and Team Situational Awareness

Open Access
Article
Conference Proceedings
Authors: Gracie Gray, Vineetha Menon, Kristin Weger, Bryan Mesmer, Nicholas Loyd
Abstract

This research introduces a multi-faceted AI-enabled big data sentiment analytics framework for modeling and predicting team performance in high-stakes simulation environments. Communication data from 40 teams participating in a firefighting simulation were collected. Big data and sentiment analysis techniques were used to examine communication dynamics and identify relationships among individual factors, team communication dynamics, and team situational awareness (TSA) and their collective predictors of mission success. By leveraging these insights, the proposed big data analysis framework provides a data-driven approach to enhance TSA, improve team interaction, and optimize human–machine coordination. It also supports the development of adaptive feedback systems, AI/ML model training, and improving performance prediction capabilities across diverse operational contexts. The findings highlight the potential of sentiment-based analytics to uncover subtle behavioral and cognitive indicators of team performance that traditional evaluation methods often overlook. This integration of human communication data with advanced analytics provides predictive indicators for team success and training optimization. This research advances the field of industrial and systems engineering by bridging behavioral analytics and performance modeling. It provides a systematic method for transforming unstructured team communication data into actionable insights that enhance decision-making, training, and human-AI collaboration in complex environments.

Keywords: Artificial Intelligence, Machine Learning, Human-Computer Interaction, Human Performance Modelling, Human-Machine Communications, Big Data Analytics, Human-Machine Interactions, Se

DOI: 10.54941/ahfe1008369

Cite this paper
Downloads
0
Visits
1
Download PDF

More from this volume

← Tangible Card Topologies or Text Prompts? Comparing AI-Human Co-Creative Story writing MethodsThe AXTENI Framework: Redefining Leadership Authority in the Age of Agentic AI →
View all articles in Human Factors in Design, Engineering, and Computing →