Credit Assignment as a Proxy for Transfer in Reinforcement Learning

  • 2019-07-18 13:02:16
  • Johan Ferret, RaphaĆ«l Marinier, Matthieu Geist, Olivier Pietquin
  • 3

Abstract

The ability to transfer representations to novel environments and tasks is asensible requirement for general learning agents. Despite the apparentpromises, transfer in Reinforcement Learning is still an open andunder-exploited research area. In this paper, we suggest that creditassignment, regarded as a supervised learning task, could be used to accomplishtransfer. Our contribution is twofold: we introduce a new credit assignmentmechanism based on self-attention, and show that the learned credit can betransferred to in-domain and out-of-domain scenarios.

 

Quick Read (beta)

loading the full paper ...