Explainable robotic systems: Interpreting outcome-focused actions in a reinforcement learning scenario

  • 2020-06-24 10:51:14
  • Francisco Cruz, Richard Dazeley, Peter Vamplew
  • 1


Robotic systems are more present in our society every day. In human-robotinteraction scenarios, it is crucial that end-users develop trust in theirrobotic team-partners, in order to collaboratively complete a task. To increasetrust, users demand more understanding about the decisions by the robot inparticular situations. Recently, explainable robotic systems have emerged as analternative focused not only on completing a task satisfactorily but also injustifying, in a human-like manner, the reasons that lead to making a decision.In reinforcement learning scenarios, a great effort has been focused onproviding explanations from the visual input modality, particularly using deeplearning-based approaches. In this work, we focus on the decision-makingprocess of a reinforcement learning agent performing a navigation task in arobotic scenario. As a way to explain the robot's behavior, we use theprobability of success computed by three different proposed approaches:memory-based, learning-based, and phenomenological-based. The differencebetween these approaches is the additional memory required to compute orestimate the probability of success as well as the kind of reinforcementlearning representation where they could be used. In this regard, we use thememory-based approach as a baseline since it is obtained directly from theagent's observations. When comparing the learning-based and thephenomenological-based approaches to this baseline, both are found to besuitable alternatives to compute the probability of success, obtaining highlevels of similarity when compared using both the Pearson's correlation and themean squared error.


Quick Read (beta)

loading the full paper ...