Evaluation of a Scale to Assess Subjective Information Processing Awareness of Humans in Interaction with Automation & Artificial Intelligence

Open Access
Article
Conference Proceedings
Authors: Tim Schrills, Marvin Sieger, Marthe Gruner, Thomas Franke
Abstract

Subjective Information Processing Awareness (SIPA) describes how users experience the extent to which a system enables them to perceive, understand and predict its information processing. With the rising interdependence of information processing in Human-AI interaction, research methods for assessing user experience in automated information processing are needed. The objective of the present research was the empirical evaluation of the SIPA scale as an economical method to assess SIPA, as well as the construction of and comparison with a version in plain language. To this end, two empirical studies were conducted (NS1= 317, NS2 = 230) to enable scale analysis. Results showed that the SIPA scale achieves excellent reliability and expected correlations with connected constructs, e.g., trust and perceived usefulness of AI systems. In addition, no benefits of a plain language variant were found. Based on the results, the SIPA scale appears to be a promising tool for examining user experience of systems with automated information processing.

Keywords: Human-Ai Interaction, Scale Development, Automated Systems

DOI: 10.54941/ahfe1004640

Cite this paper
Downloads
771
Visits
1742
Download PDF

More from this volume

← Predictive functions of artificial intelligence for risk assessment in remote hybrid workVector Result Rate (VRR): A Novel Method for Fraud detection in mobile payment systems →
View all articles in Artificial Intelligence and Social Computing →