PEORL: Integrating Symbolic Planning and Hierarchical Reinforcement Learning for Robust Decision-Making

  • 2018-05-23 16:46:13
  • Fangkai Yang, Daoming Lyu, Bo Liu, Steven Gustafson
  • 0

Abstract

Reinforcement learning and symbolic planning have both been used to buildintelligent autonomous agents. Reinforcement learning relies on learning frominteractions with real world, which often requires an unfeasibly large amountof experience. Symbolic planning relies on manually crafted symbolic knowledge,which may not be robust to domain uncertainties and changes. In this paper wepresent a unified framework {\em PEORL} that integrates symbolic planning withhierarchical reinforcement learning (HRL) to cope with decision-making in adynamic environment with uncertainties. Symbolic plans are used to guide the agent's task execution and learning, andthe learned experience is fed back to symbolic knowledge to improve planning.This method leads to rapid policy search and robust symbolic plans in complexdomains. The framework is tested on benchmark domains of HRL.

 

Quick Read (beta)

loading the full paper ...