Speech + Posture: A Method for Interaction with Multiple and Large Interactive Displays
Abstract
Multiple or Large displays play an important role in collaboration scenarios, because they can provide more display space. However, they are challenging concerning effective manipulating and managing the display contents, particularly when the displays are beyond the users' reachable region and operational limit region. In this work, we explore a particular interactive input combination for multiple or large displays, the Speech + Posture interactive input mode. We integrate postures to point to target display areas and phonetic keywords to designate display contents. This method makes interactive input commands concise and explicit, and it can support interaction with multiple or large interactive displays effectively.
Keywords: Speech, Posture, Input Modalities, Multiple Displays, Multimodal Interaction
DOI: 10.54941/ahfe100950
Cite this paper
More from this volume
- Modeling of the laminating machine based on ergonomic studies for the manufacture of marzipan handicrafts
- Cognitive Model for Probability Density Distribution Uncertainty Visualization
- Designing and Evaluating of an iPad-based Reading Mode for Enhancing the Efficiency of Non-native Immersive Reading
- Layout Evaluation of Luban Banner Interface Elements Based on Aesthetic Calculation
- Design of Point Pop-ups with Visual Representation based on Weather Map Interface
- Naturality and non-transparency of technology in the age of intelligent voice assistants
- Hybrid Sensory Surfaces: Biological meets Digital
- Design of Smart Household Beauty Apparatus Targeting the Young Consumers
- Smartphone based accurate touch operations on an AR desktop
- The near (bio)future in design
- Translating the creative process of knitwear design: from manual to digital practices in a material-driven approach
- HOYO – Shape Memory Alloys enable a new way to approach the treatment of the Autism Spectrum Disorder


AHFE Open Access