Abstract
We introduce a conceptually simple and scalable framework for continuallearning domains where tasks are learned sequentially. Our method is constantin the number of parameters and is designed to preserve performance onpreviously encountered tasks while accelerating learning progress on subsequentproblems. This is achieved through training two neural networks: A knowledgebase, capable of solving previously encountered problems, which is connected toan active column that is employed to efficiently learn the current task. Afterlearning a new task, the active column is distilled into the knowledge base,taking care to protect any previously learnt tasks. This cycle of activelearning (progression) followed by consolidation (compression) requires noarchitecture growth, no access to or storing of previous data or tasks, and notask-specific parameters. Thus, it is a learning process that may be sustainedover a lifetime of tasks while supporting forward transfer and minimisingforgetting. We demonstrate the progress & compress approach on sequentialclassification of handwritten alphabets as well as two reinforcement learningdomains: Atari games and 3D maze navigation.