Abstract
This paper proposes an inverse reinforcement learning (IRL) framework toaccelerate learning when the learner-teacher \textit{interaction} is\textit{limited} during training. Our setting is motivated by the realisticscenarios where a helpful teacher is not available or when the teacher cannotaccess the learning dynamics of the student. We present two different trainingstrategies: Curriculum Inverse Reinforcement Learning (CIRL) covering theteacher's perspective, and Self-Paced Inverse Reinforcement Learning (SPIRL)focusing on the learner's perspective. Using experiments in simulations andexperiments with a real robot learning a task from a human demonstrator, weshow that our training strategies can allow a faster training than a randomteacher for CIRL and than a batch learner for SPIRL.