Abstract
Deep Reinforcement Learning has made significant progress in multi-agentsystems in recent years. In this review article, we have mostly focused onrecent papers on Multi-Agent Reinforcement Learning (MARL) than the olderpapers, unless it was necessary. Several ideas and papers are proposed withdifferent notations, and we tried our best to unify them with a single notationand categorize them by their relevance. In particular, we have focused on fivecommon approaches on modeling and solving multi-agent reinforcement learningproblems: (I) independent-learners, (II) fully observable critic, (III) valuefunction decomposition, (IV) consensus, (IV) learn to communicate. Moreover, wediscuss some new emerging research areas in MARL along with the relevant recentpapers. In addition, some of the recent applications of MARL in real world arediscussed. Finally, a list of available environments for MARL research areprovided and the paper is concluded with proposals on the possible researchdirections.