Abstract
Deep reinforcement learning has gathered much attention recently. Impressiveresults were achieved in activities as diverse as autonomous driving, gameplaying, molecular recombination, and robotics. In all these fields, computerprograms have taught themselves to solve difficult problems. They have learnedto fly model helicopters and perform aerobatic manoeuvers such as loops androlls. In some applications they have even become better than the best humans,such as in Atari, Go, poker and StarCraft. The way in which deep reinforcementlearning explores complex environments reminds us of how children learn, byplayfully trying out things, getting feedback, and trying again. The computerseems to truly possess aspects of human learning; this goes to the heart of thedream of artificial intelligence. The successes in research have not goneunnoticed by educators, and universities have started to offer courses on thesubject. The aim of this book is to provide a comprehensive overview of thefield of deep reinforcement learning. The book is written for graduate studentsof artificial intelligence, and for researchers and practitioners who wish tobetter understand deep reinforcement learning methods and their challenges. Weassume an undergraduate-level of understanding of computer science andartificial intelligence; the programming language of this book is Python. Wedescribe the foundations, the algorithms and the applications of deepreinforcement learning. We cover the established model-free and model-basedmethods that form the basis of the field. Developments go quickly, and we alsocover advanced topics: deep multi-agent reinforcement learning, deephierarchical reinforcement learning, and deep meta learning.