Interaction-limited Inverse Reinforcement Learning

  • 2020-07-01 12:31:52
  • Martin Troussard, Emmanuel Pignat, Parameswaran Kamalaruban, Sylvain Calinon, Volkan Cevher
  • 0

Abstract

This paper proposes an inverse reinforcement learning (IRL) framework toaccelerate learning when the learner-teacher \textit{interaction} is\textit{limited} during training. Our setting is motivated by the realisticscenarios where a helpful teacher is not available or when the teacher cannotaccess the learning dynamics of the student. We present two different trainingstrategies: Curriculum Inverse Reinforcement Learning (CIRL) covering theteacher's perspective, and Self-Paced Inverse Reinforcement Learning (SPIRL)focusing on the learner's perspective. Using experiments in simulations andexperiments with a real robot learning a task from a human demonstrator, weshow that our training strategies can allow a faster training than a randomteacher for CIRL and than a batch learner for SPIRL.

 

Quick Read (beta)

loading the full paper ...