Abstract
In this paper, we explore using deep reinforcement learning for problems withmultiple agents. Most existing methods for deep multi-agent reinforcementlearning consider only a small number of agents. When the number of agentsincreases, the dimensionality of the input and control spaces increase as well,and these methods do not scale well. To address this, we propose casting themulti-agent reinforcement learning problem as a distributed optimizationproblem. Our algorithm assumes that for multi-agent settings, policies ofindividual agents in a given population live close to each other in parameterspace and can be approximated by a single policy. With this simple assumption,we show our algorithm to be extremely effective for reinforcement learning inmulti-agent settings. We demonstrate its effectiveness against existingcomparable approaches on co-operative and competitive tasks.