Applying Formal Methods to an Augmented Reality Interface

Open Access
Article
Conference Proceedings
Authors: Jeremy Gottlieb, Dan Bryce, Mieszko Muskala, Stephen Gilbert, Michael Dorneich, Shayama Khan, Maral Jafari Ranjbar, Eliot H. Winer, John Skovbekk, Robert Goldman, David Musliner
Abstract

This study applies formal methods utilizing probabilistic reasoning to integrated system models containing a human cognitive component. As the line between user, environment, and computational system becomes increasingly blurred by immersive technologies, being able to prove safety properties of the full, integrated system, instead of just the automation component increases in importance. We present a model of a human-machine system based on augmented reality and use it to reproduce results from human-centered studies of cognitive load. Specifically, we formulate a model of feature integration theory of visual search as probabilistic timed automata. The model satisfies properties related to task performance such as identify whole system. The properties, in turn, provide system design and implementation guidance. Our end-to-end modeling, verification, and validation presented here corroborates the applicability of probabilistic model checking to the human/environment/automation system in an augmented reality (AR) application. These formal models permit designers to guarantee system properties, as well as assess the impact of design choices without conducting full user studies for each decision.

Keywords: Formal Modelling, Augmented Reality, Probabilistic Timed Automaton, System Design

DOI: 10.54941/ahfe1008408

Cite this paper
Downloads
0
Visits
1
Download PDF

More from this volume

← IMAGES-AI: Generative AI to improve products for the US Navy warfighterRoom-Scale Digital Twin Sensing for Quantifying Young Children's Gaze-Based Interest and Movement Behavior →
View all articles in Human Factors in Design, Engineering, and Computing →