Autonomous Decision Making for UAV Cooperative Pursuit-Evasion Game with Reinforcement Learning

  • 2024-11-05 10:45:30
  • Yang Zhao, Zidong Nie, Kangsheng Dong, Qinghua Huang, Xuelong Li
  • 0

Abstract

The application of intelligent decision-making in unmanned aerial vehicle(UAV) is increasing, and with the development of UAV 1v1 pursuit-evasion game,multi-UAV cooperative game has emerged as a new challenge. This paper proposesa deep reinforcement learning-based model for decision-making in multi-role UAVcooperative pursuit-evasion game, to address the challenge of enabling UAV toautonomously make decisions in complex game environments. In order to enhancethe training efficiency of the reinforcement learning algorithm in UAVpursuit-evasion game environment that has high-dimensional state-action space,this paper proposes multi-environment asynchronous double deep Q-network withpriority experience replay algorithm to effectively train the UAV's gamepolicy. Furthermore, aiming to improve cooperation ability and task completionefficiency, as well as minimize the cost of UAVs in the pursuit-evasion game,this paper focuses on the allocation of roles and targets within multi-UAVenvironment. The cooperative game decision model with varying numbers of UAVsare obtained by assigning diverse tasks and roles to the UAVs in differentscenarios. The simulation results demonstrate that the proposed method enablesautonomous decision-making of the UAVs in pursuit-evasion game scenarios andexhibits significant capabilities in cooperation.

 

Quick Read (beta)

loading the full paper ...