Abstract
We discuss deep reinforcement learning in an overview style. We draw a bigpicture, filled with details. We discuss six core elements, six importantmechanisms, and twelve applications, focusing on contemporary work, and inhistorical contexts. We start with background of artificial intelligence,machine learning, deep learning, and reinforcement learning (RL), withresources. Next we discuss RL core elements, including value function, policy,reward, model, exploration vs. exploitation, and representation. Then wediscuss important mechanisms for RL, including attention and memory,unsupervised learning, hierarchical RL, multi-agent RL, relational RL, andlearning to learn. After that, we discuss RL applications, including games,robotics, natural language processing (NLP), computer vision, finance, businessmanagement, healthcare, education, energy, transportation, computer systems,and, science, engineering, and art. Finally we summarize briefly, discusschallenges and opportunities, and close with an epilogue.