Explainable robotic systems: Understanding goal-driven actions in a reinforcement learning scenario

  • 2020-07-29 05:47:44
  • Francisco Cruz, Richard Dazeley, Peter Vamplew
  • 0

Abstract

Robotic systems are more present in our society everyday. In human-robotenvironments, it is crucial that end-users may correctly understand theirrobotic team-partners, in order to collaboratively complete a task. To increaseaction understanding, users demand more explainability about the decisions bythe robot in particular situations. Recently, explainable robotic systems haveemerged as an alternative focused not only on completing a task satisfactorily,but also in justifying, in a human-like manner, the reasons that lead to makinga decision. In reinforcement learning scenarios, a great effort has beenfocused on providing explanations using data-driven approaches, particularlyfrom the visual input modality in deep learning-based systems. In this work, wefocus on the decision-making process of a reinforcement learning agentperforming a simple navigation task in a robotic scenario. As a way to explainthe goal-driven robot's actions, we use the probability of success computed bythree different proposed approaches: memory-based, learning-based, andintrospection-based. The difference between these approaches is the amount ofmemory required to compute or estimate the probability of success as well asthe kind of reinforcement learning representation where they could be used. Inthis regard, we use the memory-based approach as a baseline since it isobtained directly from the agent's observations. When comparing thelearning-based and the introspection-based approaches to this baseline, bothare found to be suitable alternatives to compute the probability of success,obtaining high levels of similarity when compared using both the Pearson'scorrelation and the mean squared error.

 

Quick Read (beta)

loading the full paper ...