Abstract
We characterize the effectiveness of Sharpness-aware minimization (SAM) undermachine unlearning scheme, where unlearning forget signals interferes withlearning retain signals. While previous work prove that SAM improvesgeneralization with noise memorization prevention, we show that SAM abandonssuch denoising property when fitting the forget set, leading to various testerror bounds depending on signal strength. We further characterize the signalsurplus of SAM in the order of signal strength, which enables learning fromless retain signals to maintain model performance and putting more weight onunlearning the forget set. Empirical studies show that SAM outperforms SGD withrelaxed requirement for retain signals and can enhance various unlearningmethods either as pretrain or unlearn algorithm. Observing that overfitting canbenefit more stringent sample-specific unlearning, we propose Sharp MinMax,which splits the model into two to learn retain signals with SAM and unlearnforget signals with sharpness maximization, achieving best performance.Extensive experiments show that SAM enhances unlearning across varyingdifficulties measured by data memorization, yielding decreased featureentanglement between retain and forget sets, stronger resistance to membershipinference attacks, and a flatter loss landscape.