Abstract
Incremental learning (IL) has received a lot of attention recently, however,the literature lacks a precise problem definition, proper evaluation settings,and metrics tailored specifically for the IL problem. One of the mainobjectives of this work is to fill these gaps so as to provide a common groundfor better understanding of IL. The main challenge for an IL algorithm is toupdate the classifier whilst preserving existing knowledge. We observe that, inaddition to forgetting, a known issue while preserving knowledge, IL alsosuffers from a problem we call intransigence, inability of a model to updateits knowledge. We introduce two metrics to quantify forgetting andintransigence that allow us to understand, analyse, and gain better insightsinto the behaviour of IL algorithms. We present RWalk, a generalization ofEWC++ (our efficient version of EWC [Kirkpatrick2016EWC]) and Path Integral[Zenke2017Continual] with a theoretically grounded KL-divergence basedperspective. We provide a thorough analysis of various IL algorithms on MNISTand CIFAR-100 datasets. In these experiments, RWalk obtains superior results interms of accuracy, and also provides a better trade-off between forgetting andintransigence.