EVO-RL: Evolutionary-Driven Reinforcement Learning

  • 2020-07-10 16:14:58
  • Ahmed Hallawa, Thorsten Born, Anke Schmeink, Guido Dartmann, Arne Peine, Lukas Martin, Giovanni Iacca, A. E. Eiben, Gerd Ascheid
  • 0

Abstract

In this work, we propose a novel approach for reinforcement learning drivenby evolutionary computation. Our algorithm, dubbed as Evolutionary-DrivenReinforcement Learning (evo-RL), embeds the reinforcement learning algorithm inan evolutionary cycle, where we distinctly differentiate between purelyevolvable (instinctive) behaviour versus purely learnable behaviour.Furthermore, we propose that this distinction is decided by the evolutionaryprocess, thus allowing evo-RL to be adaptive to different environments. Inaddition, evo-RL facilitates learning on environments with rewardless states,which makes it more suited for real-world problems with incomplete information.To show that evo-RL leads to state-of-the-art performance, we present theperformance of different state-of-the-art reinforcement learning algorithmswhen operating within evo-RL and compare it with the case when these samealgorithms are executed independently. Results show that reinforcement learningalgorithms embedded within our evo-RL approach significantly outperform thestand-alone versions of the same RL algorithms on OpenAI Gym control problemswith rewardless states constrained by the same computational budget.

 

Quick Read (beta)

loading the full paper ...