A Controlled Comparison of MARL Training-Execution Paradigms for Cooperative Multi-UAV Fire Detection

Open Access
Article
Conference Proceedings
Authors: Tanvi Chanchalani, Fuhua Lin
Abstract

This paper presents a controlled empirical comparison of three fundamental multi-agent reinforcement learning (MARL) paradigms, the Centralized Training and Execution (CTE), Decentralized Training and Execution (DTE), and Centralized Training with Decentralized Execution (CTDE), in a cooperative Unmanned Aerial Vehicle (UAV) fire-detection environment under identical task conditions. In MARL, the training and execution architecture shapes what the agents can see, what they can coordinate on, and how stable the learning problem is. Our study addressed a gap where paradigm-level comparison under controlled settings remains scarce. Results across four benchmark scenarios and a 6 to 15 agents scalability test show that CTDE may be the most reliable paradigm, winning Level-1 mission completion in three of four scenarios and Level-3 path quality in all four. CTE provides a measurable advantage over CTDE in Hard-Dynamic, where execution-time global state conditioning enables faster response to mid-episode fire spawning, but its joint action space of 4^n renders it infeasible beyond thirteen agents. DTE fails systematically due to non-stationarity, with lower completion rates across all configurations and apparent safety gains that are artefacts of coordination failure rather than genuine collision avoidance. These findings confirm that paradigm choice is a first-order design decision in cooperative MARL and that CTDE may be a promising architecture for coordination-intensive multi-agent deployments at moderate to large scales.

Keywords: Multi-Agent Reinforcement Learning, Wildfire Detection

DOI: 10.54941/ahfe1008489

Cite this paper
Downloads
0
Visits
1
Download PDF

More from this volume

← Eye-Tracking Factors During Spatial Ability Task Predict IRT-Based Item Difficulty and Naval Flight Training PerformanceEmbodied Empathy as Pedagogy: A Consumer Tribe Field Immersion Activity for Customer Experience Professional Formation →
View all articles in Human Factors in Design, Engineering, and Computing →