Mutual Reinforcement Learning

  • 2019-07-15 20:10:29
  • Sayanti Roy, Emily Kieson, Charles Abramson, Christopher Crick
  • 11

Abstract

Recently, collaborative robots have begun to train humans to achieve complextasks, and the mutual information exchange between them can lead to successfulrobot-human collaborations. In this paper we demonstrate the application andeffectiveness of a new approach called \textit{mutual reinforcement learning}(MRL), where both humans and autonomous agents act as reinforcement learners ina skill transfer scenario over continuous communication and feedback. Anautonomous agent initially acts as an instructor who can teach a novice humanparticipant complex skills using the MRL strategy. While teaching skills in aphysical (block-building) ($n=34$) or simulated (Tetris) environment ($n=31$),the expert tries to identify appropriate reward channels preferred by eachindividual and adapts itself accordingly using an exploration-exploitationstrategy. These reward channel preferences can identify important behaviors ofthe human participants, because they may well exercise the same behaviors insimilar situations later. In this way, skill transfer takes place between anexpert system and a novice human operator. We divided the subject populationinto three groups and observed the skill transfer phenomenon, analyzing it withSimpson"s psychometric model. 5-point Likert scales were also used to identifythe cognitive models of the human participants. We obtained a shared cognitivemodel which not only improves human cognition but enhances the robot'scognitive strategy to understand the mental model of its human partners whilebuilding a successful robot-human collaborative framework.

 

Quick Read (beta)

loading the full paper ...