Abstract
A long-term goal of reinforcement learning agents is to be able to performtasks in complex real-world scenarios. The use of external information is oneway of scaling agents to more complex problems. However, there is a generallack of collaboration or interoperability between different approaches usingexternal information. In this work, we propose a conceptual framework andtaxonomy for assisted reinforcement learning, aimed at fostering suchcollaboration by classifying and comparing various methods that use externalinformation in the learning process. The proposed taxonomy details therelationship between the external information source and the learner agent,highlighting the process of information decomposition, structure, retention,and how it can be used to influence agent learning. As well as reviewingstate-of-the-art methods, we identify current streams of reinforcement learningthat use external information in order to improve the agent's performance andits decision-making process. These include heuristic reinforcement learning,interactive reinforcement learning, learning from demonstration, transferlearning, and learning from multiple sources, among others. These streams ofreinforcement learning operate with the shared objective of scaffolding thelearner agent. Lastly, we discuss further possibilities for future work in thefield of assisted reinforcement learning systems.