Toward Policy Explanations for Multi-Agent Reinforcement Learning

  • 2022-05-11 20:26:15
  • Kayla Boggess, Sarit Kraus, Lu Feng
  • 0

Abstract

Advances in multi-agent reinforcement learning (MARL) enable sequentialdecision making for a range of exciting multi-agent applications such ascooperative AI and autonomous driving. Explaining agent decisions is crucialfor improving system transparency, increasing user satisfaction, andfacilitating human-agent collaboration. However, existing works on explainablereinforcement learning mostly focus on the single-agent setting and are notsuitable for addressing challenges posed by multi-agent environments. Wepresent novel methods to generate two types of policy explanations for MARL:(i) policy summarization about the agent cooperation and task sequence, and(ii) language explanations to answer queries about agent behavior. Experimentalresults on three MARL domains demonstrate the scalability of our methods. Auser study shows that the generated explanations significantly improve userperformance and increase subjective ratings on metrics such as usersatisfaction.

 

Quick Read (beta)

loading the full paper ...