Abstract
Reinforcement learning (RL) has become an increasingly active area ofresearch in recent years. Although there are many algorithms that allow anagent to solve tasks efficiently, they often ignore the possibility that priorexperience related to the task at hand might be available. For many practicalapplications, it might be unfeasible for an agent to learn how to solve a taskfrom scratch, given that it is generally a computationally expensive process;however, prior experience could be leveraged to make these problems tractablein practice. In this paper, we propose a framework for exploiting existingexperience by learning reusable options. We show that after an agent learnspolicies for solving a small number of problems, we are able to use thetrajectories generated from those policies to learn reusable options that allowan agent to quickly learn how to solve novel and related problems.