Abstract
In this paper we propose a new training loop for deep reinforcement learningagents with an evolutionary generator. Evolutionary procedural contentgeneration has been used in the creation of maps and levels for games before.Our system incorporates an evolutionary map generator to construct a trainingcurriculum that is evolved to maximize loss within the state-of-the-art DoubleDueling Deep Q Network architecture with prioritized replay. We present acase-study in which we prove the efficacy of our new method on a game with adiscrete, large action space we made called Attackers and Defenders. Ourresults demonstrate that training on an evolutionarily-curated curriculum(directed sampling) of maps both expedites training and improves generalizationwhen compared to a network trained on an undirected sampling of maps.