Robust Deep Reinforcement Learning with Adversarial Attacks

  • 2017-12-11 02:58:13
  • Anay Pattanaik, Zhenyi Tang, Shuijing Liu, Gautham Bommannan, Girish Chowdhary
  • 19

Abstract

This paper proposes adversarial attacks for Reinforcement Learning (RL) andthen improves the robustness of Deep Reinforcement Learning algorithms (DRL) toparameter uncertainties with the help of these attacks. We show that even anaively engineered attack successfully degrades the performance of DRLalgorithm. We further improve the attack using gradient information of anengineered loss function which leads to further degradation in performance.These attacks are then leveraged during training to improve the robustness ofRL within robust control framework. We show that this adversarial training ofDRL algorithms like Deep Double Q learning and Deep Deterministic PolicyGradients leads to significant increase in robustness to parameter variationsfor RL benchmarks such as Cart-pole, Mountain Car, Hopper and Half Cheetahenvironment.

 

Quick Read (beta)

loading the full paper ...