Imagination-Augmented Agents for Deep Reinforcement Learning

  • 2018-02-14 17:26:18
  • Théophane Weber, Sébastien Racanière, David P. Reichert, Lars Buesing, Arthur Guez, Danilo Jimenez Rezende, Adria Puigdomènech Badia, Oriol Vinyals, Nicolas Heess, Yujia Li, Razvan Pascanu, Peter Battaglia, Demis Hassabis, David Silver, Daan Wierstra
  • 0

Abstract

We introduce Imagination-Augmented Agents (I2As), a novel architecture fordeep reinforcement learning combining model-free and model-based aspects. Incontrast to most existing model-based reinforcement learning and planningmethods, which prescribe how a model should be used to arrive at a policy, I2Aslearn to interpret predictions from a learned environment model to constructimplicit plans in arbitrary ways, by using the predictions as additionalcontext in deep policy networks. I2As show improved data efficiency,performance, and robustness to model misspecification compared to severalbaselines.

 

Quick Read (beta)

loading the full paper ...