Abstract
Class-Incremental Learning (CIL) trains a model to continually recognize newclasses from non-stationary data while retaining learned knowledge. A majorchallenge of CIL arises when applying to real-world data characterized bynon-uniform distribution, which introduces a dual imbalance problem involving(i) disparities between stored exemplars of old tasks and new class data(inter-phase imbalance), and (ii) severe class imbalances within eachindividual task (intra-phase imbalance). We show that this dual imbalance issuecauses skewed gradient updates with biased weights in FC layers, thus inducingover/under-fitting and catastrophic forgetting in CIL. Our method addresses itby reweighting the gradients towards balanced optimization and unbiasedclassifier learning. Additionally, we observe imbalanced forgetting whereparadoxically the instance-rich classes suffer higher performance degradationduring CIL due to a larger amount of training data becoming unavailable insubsequent learning phases. To tackle this, we further introduce adistribution-aware knowledge distillation loss to mitigate forgetting byaligning output logits proportionally with the distribution of lost trainingdata. We validate our method on CIFAR-100, ImageNetSubset, and Food101 acrossvarious evaluation protocols and demonstrate consistent improvements comparedto existing works, showing great potential to apply CIL in real-world scenarioswith enhanced robustness and effectiveness.