Abstract
Recently, deep Reinforcement Learning (RL) algorithms have achieveddramatically progress in the multi-agent area. However, training theincreasingly complex tasks would be time-consuming and resources-exhausting. Toalleviate this problem, efficient leveraging the historical experience isessential, which is under-explored in previous studies as most of the exitingmethods may fail to achieve this goal in a continuously variational system dueto their complicated design and environmental dynamics. In this paper, wepropose a method, named "KnowRU" for knowledge reusing which can be easilydeployed in the majority of the multi-agent reinforcement learning algorithmswithout complicated hand-coded design. We employ the knowledge distillationparadigm to transfer the knowledge among agents with the goal to accelerate thetraining phase for new tasks, while improving the asymptotic performance ofagents. To empirically demonstrate the robustness and effectiveness of KnowRU,we perform extensive experiments on state-of-the-art multi-agent reinforcementlearning (MARL) algorithms on collaborative and competitive scenarios. Theresults show that KnowRU can outperform the recently reported methods, whichemphasizes the importance of the proposed knowledge reusing for MARL.