Abstract
Active learning from demonstration allows a robot to query a human forspecific types of input to achieve efficient learning. Existing work hasexplored a variety of active query strategies; however, to our knowledge, noneof these strategies directly minimize the performance risk of the policy therobot is learning. Utilizing recent advances in performance bounds for inversereinforcement learning, we propose a risk-aware active inverse reinforcementlearning algorithm that focuses active queries on areas of the state space withthe potential for large generalization error. We show that risk-aware activelearning outperforms standard active IRL approaches on gridworld, simulateddriving, and table setting tasks, while also providing a performance-basedstopping criterion that allows a robot to know when it has received enoughdemonstrations to safely perform a task.