Abstract
Reinforcement learning (RL), particularly its combination with deep neuralnetworks referred to as deep RL (DRL), has shown tremendous promise across awide range of applications, suggesting its potential for enabling thedevelopment of sophisticated robotic behaviors. Robotics problems, however,pose fundamental difficulties for the application of RL, stemming from thecomplexity and cost of interacting with the physical world. This articleprovides a modern survey of DRL for robotics, with a particular focus onevaluating the real-world successes achieved with DRL in realizing several keyrobotic competencies. Our analysis aims to identify the key factors underlyingthose exciting successes, reveal underexplored areas, and provide an overallcharacterization of the status of DRL in robotics. We highlight severalimportant avenues for future work, emphasizing the need for stable andsample-efficient real-world RL paradigms, holistic approaches for discoveringand integrating various competencies to tackle complex long-horizon, open-worldtasks, and principled development and evaluation procedures. This survey isdesigned to offer insights for both RL practitioners and roboticists towardharnessing RL's power to create generally capable real-world robotic systems.