Abstract
Reinforcement learning research obtained significant success and attentionwith the utilization of deep neural networks to solve problems in highdimensional state or action spaces. While deep reinforcement learning policiesare currently being deployed in many different fields from medical applicationsto large language models, there are still ongoing questions the field is tryingto answer on the generalization capabilities of deep reinforcement learningpolicies. In this paper, we will formalize and analyze generalization in deepreinforcement learning. We will explain the fundamental reasons why deepreinforcement learning policies encounter overfitting problems that limit theirgeneralization capabilities. Furthermore, we will categorize and explain themanifold solution approaches to increase generalization, and overcomeoverfitting in deep reinforcement learning policies. From exploration toadversarial analysis and from regularization to robustness our paper providesan analysis on a wide range of subfields within deep reinforcement learningwith a broad scope and in-depth view. We believe our study can provide acompact guideline for the current advancements in deep reinforcement learning,and help to construct robust deep neural policies with higher generalizationskills.