Abstract
The reinforcement learning (RL) research area is very active, with animportant number of new contributions; especially considering the emergentfield of deep RL (DRL). However a number of scientific and technical challengesstill need to be addressed, amongst which we can mention the ability toabstract actions or the difficulty to explore the environment which can beaddressed by intrinsic motivation (IM). In this article, we provide a survey onthe role of intrinsic motivation in DRL. We categorize the different kinds ofintrinsic motivations and detail for each category, its advantages andlimitations with respect to the mentioned challenges. Additionnally, we conductan in-depth investigation of substantial current research questions, that arecurrently under study or not addressed at all in the considered research areaof DRL. We choose to survey these research works, from the perspective oflearning how to achieve tasks. We suggest then, that solving current challengescould lead to a larger developmental architecture which may tackle most of thetasks. We describe this developmental architecture on the basis of severalbuilding blocks composed of a RL algorithm and an IM module compressinginformation.