Abstract
Multi-agent reinforcement learning (MARL) has recently received considerableattention due to its applicability to a wide range of real-world applications.However, achieving efficient communication among agents has always been anoverarching problem in MARL. In this work, we propose Variance Based Control(VBC), a simple yet efficient technique to improve communication efficiency inMARL. By limiting the variance of the exchanged messages between agents duringthe training phase, the noisy component in the messages can be eliminatedeffectively, while the useful part can be preserved and utilized by the agentsfor better performance. Our evaluation using a challenging set of StarCraft IIbenchmarks indicates that our method achieves $2-10\times$ lower incommunication overhead than state-of-the-art MARL algorithms, while allowingagents to better collaborate by developing sophisticated strategies.