Abstract
Inverse reinforcement learning is the problem of inferring the rewardfunction of an observed agent, given its policy or behavior. Researchersperceive IRL both as a problem and as a class of methods. By categoricallysurveying the current literature in IRL, this article serves as a reference forresearchers and practitioners in machine learning to understand the challengesof IRL and select the approaches best suited for the problem on hand. Thesurvey formally introduces the IRL problem along with its central challengeswhich include accurate inference, generalizability, correctness of priorknowledge, and growth in solution complexity with problem size. The articleelaborates how the current methods mitigate these challenges. We furtherdiscuss the extensions of traditional IRL methods: (i) inaccurate andincomplete perception, (ii) incomplete model, (iii) multiple rewards, and (iv)non-linear reward functions. This discussion concludes with some broad advancesin the research area and currently open research questions.