Abstract

We propose Ephemeral Value Adjusments (EVA): a means of allowing deepreinforcement learning agents to rapidly adapt to experience in their replaybuffer. EVA shifts the value predicted by a neural network with an estimate ofthe value function found by planning over experience tuples from the replaybuffer near the current state. EVA combines a number of recent ideas aroundcombining episodic memory-like structures into reinforcement learning agents:slot-based storage, content-based retrieval, and memory-based planning. We showthat EVAis performant on a demonstration task and Atari games.

 

Quick Read (beta)