Abstract
With the rapid development of artificial intelligence, intelligentdecision-making techniques have gradually surpassed human levels in varioushuman-machine competitions, especially in complex multi-agent cooperative taskscenarios. Multi-agent cooperative decision-making involves multiple agentsworking together to complete established tasks and achieve specific objectives.These techniques are widely applicable in real-world scenarios such asautonomous driving, drone navigation, disaster rescue, and simulated militaryconfrontations. This paper begins with a comprehensive survey of the leadingsimulation environments and platforms used for multi-agent cooperativedecision-making. Specifically, we provide an in-depth analysis for thesesimulation environments from various perspectives, including task formats,reward allocation, and the underlying technologies employed. Subsequently, weprovide a comprehensive overview of the mainstream intelligent decision-makingapproaches, algorithms and models for multi-agent systems (MAS).Theseapproaches can be broadly categorized into five types: rule-based(primarily fuzzy logic), game theory-based, evolutionary algorithms-based, deepmulti-agent reinforcement learning (MARL)-based, and large languagemodels(LLMs)reasoning-based. Given the significant advantages of MARLandLLMs-baseddecision-making methods over the traditional rule, game theory,and evolutionary algorithms, this paper focuses on these multi-agent methodsutilizing MARL and LLMs-based techniques. We provide an in-depth discussion ofthese approaches, highlighting their methodology taxonomies, advantages, anddrawbacks. Further, several prominent research directions in the future andpotential challenges of multi-agent cooperative decision-making are alsodetailed.