Abstract
Curriculum learning in reinforcement learning is a training methodology thatseeks to speed up learning of a difficult target task, by first training on aseries of simpler tasks and transferring the knowledge acquired to the targettask. Automatically choosing a sequence of such tasks (i.e. a curriculum) is anopen problem that has been the subject of much recent work in this area. Inthis paper, we build upon a recent method for curriculum design, whichformulates the curriculum sequencing problem as a Markov Decision Process. Weextend this model to handle multiple transfer learning algorithms, and show forthe first time that a curriculum policy over this MDP can be learned fromexperience. We explore various representations that make this possible, andevaluate our approach by learning curriculum policies for multiple agents intwo different domains. The results show that our method produces curricula thatcan train agents to perform on a target task as fast or faster than existingmethods.