Federated Deep Reinforcement Learning

  • 2020-02-09 12:30:36
  • Hankz Hankui Zhuo, Wenfeng Feng, Yufeng Lin, Qian Xu, Qiang Yang
  • 0

Abstract

In deep reinforcement learning, building policies of high-quality ischallenging when the feature space of states is small and the training data islimited. Despite the success of previous transfer learning approaches in deepreinforcement learning, directly transferring data or models from an agent toanother agent is often not allowed due to the privacy of data and/or models inmany privacy-aware applications. In this paper, we propose a novel deepreinforcement learning framework to federatively build models of high-qualityfor agents with consideration of their privacies, namely Federated deepReinforcement Learning (FedRL). To protect the privacy of data and models, weexploit Gausian differentials on the information shared with each other whenupdating their local models. In the experiment, we evaluate our FedRL frameworkin two diverse domains, Grid-world and Text2Action domains, by comparing tovarious baselines.

 

Quick Read (beta)

loading the full paper ...