Abstract
Teams of autonomous unmanned aircraft can be used to monitor wildfires,enabling firefighters to make informed decisions. However, controlling multipleautonomous fixed-wing aircraft to maximize forest fire coverage is a complexproblem. The state space is high dimensional, the fire propagatesstochastically, the sensor information is imperfect, and the aircraft mustcoordinate with each other to accomplish their mission. This work presents twodeep reinforcement learning approaches for training decentralized controllersthat accommodate the high dimensionality and uncertainty inherent in theproblem. The first approach controls the aircraft using immediate observationsof the individual aircraft. The second approach allows aircraft to collaborateon a map of the wildfire's state and maintain a time history of locationsvisited, which are used as inputs to the controller. Simulation results showthat both approaches allow the aircraft to accurately track wildfire expansionsand outperform an online receding horizon controller. Additional simulationsdemonstrate that the approach scales with different numbers of aircraft andgeneralizes to different wildfire shapes.