Deep Reinforcement Learning has made significant progress in multi-agentsystems in recent years. In this review article, we have focused on presentingrecent approaches on Multi-Agent Reinforcement Learning (MARL) algorithms. Inparticular, we have focused on five common approaches on modeling and solvingcooperative multi-agent reinforcement learning problems: (I) independentlearners, (II) fully observable critic, (III) value function factorization,(IV) consensus, and (IV) learn to communicate. First, we elaborate on each ofthese methods, possible challenges, and how these challenges were mitigated inthe relevant papers. If applicable, we further make a connection amongdifferent papers in each category. Next, we cover some new emerging researchareas in MARL along with the relevant recent papers. Due to the recent successof MARL in real-world applications, we assign a section to provide a review ofthese applications and corresponding articles. Also, a list of available environments for MARL research is provided in thissurvey. Finally, the paper is concluded with proposals on the possible researchdirections.