Abstract
Deep learning techniques have been widely applied, achieving state-of-the-artresults in various fields of study. This survey focuses on deep learningsolutions that target learning control policies for robotics applications. Wecarry out our discussions on the two main paradigms for learning control withdeep networks: deep reinforcement learning and imitation learning. For deepreinforcement learning (DRL), we begin from traditional reinforcement learningalgorithms, showing how they are extended to the deep context and effectivemechanisms that could be added on top of the DRL algorithms. We then introducerepresentative works that utilize DRL to solve navigation and manipulationtasks in robotics. We continue our discussion on methods addressing thechallenge of the reality gap for transferring DRL policies trained insimulation to real-world scenarios, and summarize robotics simulation platformsfor conducting DRL research. For imitation leaning, we go through its threemain categories, behavior cloning, inverse reinforcement learning andgenerative adversarial imitation learning, by introducing their formulationsand their corresponding robotics applications. Finally, we discuss the openchallenges and research frontiers.