Artificial neural networks thrive in solving the classification problem for aparticular rigid task, acquiring knowledge through generalized learningbehaviour from a distinct training phase. The resulting network resembles astatic entity of knowledge, with endeavours to extend this knowledge withouttargeting the original task resulting in a catastrophic forgetting. Continuallearning shifts this paradigm towards networks that can continually accumulateknowledge over different tasks without the need to retrain from scratch. Wefocus on task incremental classification, where tasks arrive sequentially andare delineated by clear boundaries. Our main contributions concern 1) ataxonomy and extensive overview of the state-of-the-art, 2) a novel frameworkto continually determine the stability-plasticity trade-off of the continuallearner, 3) a comprehensive experimental comparison of 11 state-of-the-artcontinual learning methods and 4 baselines. We empirically scrutinize methodstrengths and weaknesses on three benchmarks, considering Tiny Imagenet andlarge-scale unbalanced iNaturalist and a sequence of recognition datasets. Westudy the influence of model capacity, weight decay and dropout regularization,and the order in which the tasks are presented, and qualitatively comparemethods in terms of required memory, computation time, and storage.