Abstract
Reinforcement learning is a learning paradigm for solving sequentialdecision-making problems. Recent years have witnessed remarkable progress inreinforcement learning upon the fast development of deep neural networks. Alongwith the promising prospects of reinforcement learning in numerous domains suchas robotics and game-playing, transfer learning has arisen to tackle variouschallenges faced by reinforcement learning, by transferring knowledge fromexternal expertise to facilitate the efficiency and effectiveness of thelearning process. In this survey, we systematically investigate the recentprogress of transfer learning approaches in the context of deep reinforcementlearning. Specifically, we provide a framework for categorizing thestate-of-the-art transfer learning approaches, under which we analyze theirgoals, methodologies, compatible reinforcement learning backbones, andpractical applications. We also draw connections between transfer learning andother relevant topics from the reinforcement learning perspective and exploretheir potential challenges that await future research progress.