Automata-Guided Hierarchical Reinforcement Learning for Skill Composition

  • 2018-05-21 01:38:04
  • Xiao Li, Yao Ma, Calin Belta
  • 0

Abstract

Skills learned through (deep) reinforcement learning often generalizes poorlyacross domains and re-training is necessary when presented with a new task. Wepresent a framework that combines techniques in \textit{formal methods} with\textit{reinforcement learning} (RL). The methods we provide allows forconvenient specification of tasks with logical expressions, learns hierarchicalpolicies (meta-controller and low-level controllers) with well-definedintrinsic rewards, and construct new skills from existing ones with little tono additional exploration. We evaluate the proposed methods in a simple gridworld simulation as well as a more complicated kitchen environment in AI2Thor

 

Quick Read (beta)

loading the full paper ...