Abstract
Hierarchical reinforcement learning (HRL) is hypothesized to be able to takeadvantage of the inherent hierarchy in robot learning tasks with sparse rewardschemes, in contrast to more traditional reinforcement learning algorithms. Inthis research, hierarchical reinforcement learning is evaluated and contrastedwith standard reinforcement learning in complex navigation tasks. We evaluateunique characteristics of HRL, including their ability to create sub-goals andthe termination function. We constructed experiments to test the differencesbetween PPO and HRL, different ways of creating sub-goals, manual vs automaticsub-goal creation, and the effects of the frequency of termination onperformance. These experiments highlight the advantages of HRL and how itachieves these advantages.