Dealing with Sparse Rewards in Reinforcement Learning

  • 2019-11-11 14:18:31
  • Joshua Hare
  • 0

Abstract

Successfully navigating a complex environment to obtain a desired outcome isa difficult task, that up to recently was believed to be capable only byhumans. This perception has been broken down over time, especially with theintroduction of deep reinforcement learning, which has greatly increased thedifficulty of tasks that can be automated. However, for traditionalreinforcement learning agents this requires an environment to be able toprovide frequent extrinsic rewards, which are not known or accessible for manyreal-world environments. This project aims to explore and contrast existingreinforcement learning solutions that circumnavigate the difficulties of anenvironment that provide sparse rewards. Different reinforcement solutions willbe implemented over a several video game environments with varying difficultyand varying frequency of rewards, as to properly investigate the applicabilityof these solutions. This project introduces a novel reinforcement learningsolution by combining aspects of two existing state of the art sparse rewardsolutions, curiosity driven exploration and unsupervised auxiliary tasks.

 

Quick Read (beta)

loading the full paper ...