Abstract
Reinforcement learning is a powerful technique to train an agent to perform atask. However, an agent that is trained using reinforcement learning is onlycapable of achieving the single task that is specified via its reward function.Such an approach does not scale well to settings in which an agent needs toperform a diverse set of tasks, such as navigating to varying positions in aroom or moving objects to varying locations. Instead, we propose a method thatallows an agent to automatically discover the range of tasks that it is capableof performing. We use a generator network to propose tasks for the agent to tryto achieve, specified as goal states. The generator network is optimized usingadversarial training to produce tasks that are always at the appropriate levelof difficulty for the agent. Our method thus automatically produces acurriculum of tasks for the agent to learn. We show that, by using thisframework, an agent can efficiently and automatically learn to perform a wideset of tasks without requiring any prior knowledge of its environment. Ourmethod can also learn to achieve tasks with sparse rewards, which traditionallypose significant challenges.