Abstract
Autonomous agents operating in domains such as robotics or video gamesimulations must adapt to changing tasks without forgetting about the previousones. This process called Continual Reinforcement Learning poses non-trivialdifficulties, from preventing catastrophic forgetting to ensuring thescalability of the approaches considered. Building on recent advances, weintroduce a benchmark providing a suite of video-game navigation scenarios,thus filling a gap in the literature and capturing key challenges :catastrophic forgetting, task adaptation, and memory efficiency. We define aset of various tasks and datasets, evaluation protocols, and metrics to assessthe performance of algorithms, including state-of-the-art baselines. Ourbenchmark is designed not only to foster reproducible research and toaccelerate progress in continual reinforcement learning for gaming, but also toprovide a reproducible framework for production pipelines -- helpingpractitioners to identify and to apply effective approaches.