Abstract
Reinforcement learning (RL) -- algorithms that teach artificial agents tointeract with environments by maximising reward signals -- has achievedsignificant success in recent years. These successes have been facilitated byadvances in algorithms (e.g., deep Q-learning, deep deterministic policygradients, proximal policy optimisation, trust region policy optimisation, andsoft actor-critic) and specialised computational resources such as GPUs andTPUs. One promising research direction involves introducing goals to allowmultimodal policies, commonly through hierarchical or curriculum reinforcementlearning. These methods systematically decompose complex behaviours intosimpler sub-tasks, analogous to how humans progressively learn skills (e.g. welearn to run before we walk, or we learn arithmetic before calculus). However,fully automating goal creation remains an open challenge. We present a novelprobabilistic curriculum learning algorithm to suggest goals for reinforcementlearning agents in continuous control and navigation tasks.