Human-Friendly Control of Drones and Drone Swarms Using Natural Language and AI-Based Task Decomposition
Abstract
The deployment of drones and swarms of small drones for operational purposes is rapidly increasing the load on human operators especially if interaction relies on low-level control interfaces. This paper reports work carried out as part of a project on human-centric drone control by natural language interaction and AI-augmented task understanding. With the proposed method, operators are able to give high-level commands to single or small groups of drones and task-representations are structured from these commands and executed with predefined mission primitives. The focus of the system is to promote transparency and operator supervision through explicit feedback about the interpretation of tasks and task execution.
Keywords: Human–drone Interaction, Natural Language Interfaces, Drone Swarms, Human-centred Autonomy
DOI: 10.54941/ahfe1007683
Cite this paper
More from this volume
- Workshop: Orchestrating Synthesized Human and AI-Agentic Workflows: AI Agency Benefits, Disruptions and Management
- The Risks, Challenges, and Potential Opportunities with GenAI
- Agentic LLMs for Scalable, Verifiable System Health Digital Twins
- When Workflows Stay Stable but Meaning Moves in Agentic Analyst Pipelines
- Effects of Swarm Size Variability on Operator Workload
- A Computer-Vision Approach to Accessible Robot Control: Hand Gesture Recognition for Users With Limited Mobility or Speech
- Emotive Design Heuristics: A Methodology for Creating and Validating Empathetic Design Heuristics for Human-Robot Interaction
- User Perception and Sentiment Analysis of Knee exoskeletons for Hiking Based on Social Media Comments: A Preliminary Study
- Effects of Robot Non-Verbal Behaviors on Human Emotion Recognition in Human–Robot Communication
- Rule-Based Interpretable AI for Concurrent Collision Detection in Industrial Robot Manipulators
- Human Factors in the Design of Human–Machine Interfaces for Counter-Drone Systems
- European University–Industry Collaboration for Civil Counter-Drone Protection: A Human-Centered, AI-Game-Based Socio-Technical Systems Approach


AHFE Open Access