Interpretable Latent Spaces for Learning from Demonstration

  • 2018-07-17 17:56:09
  • Yordan Hristov, Alex Lascarides, Subramanian Ramamoorthy
  • 9

Abstract

Effective human-robot interaction, such as in robot learning from humandemonstration, requires the learning agent to be able to ground abstractconcepts (such as those contained within instructions) in a correspondinghigh-dimensional sensory input stream from the world. Models such as deepneural networks, with high capacity through their large parameter spaces, canbe used to compress the high-dimensional sensory data to lower dimensionalrepresentations. These low-dimensional representations facilitate symbolgrounding, but may not guarantee that the representation would behuman-interpretable. We propose a method which utilises the grouping ofuser-defined symbols and their corresponding sensory observations in order toalign the learnt compressed latent representation with the semantic notionscontained in the abstract labels. We demonstrate this through experiments withboth simulated and real-world object data, showing that such alignment can beachieved in a process of physical symbol grounding.

 

Quick Read (beta)

loading the full paper ...