Abstract
We formulate the machine unlearning problem as a general constrainedoptimization problem. It unifies the first-order methods from the approximatemachine unlearning literature. This paper then introduces the concept offeasible updates as the model's parameter update directions that help withunlearning while not degrading the utility of the initial model. Our design offeasible updates is based on masking, \ie\ a careful selection of the model'sparameters worth updating. It also takes into account the estimation noise ofthe gradients when processing each batch of data to offer a statisticalguarantee to derive locally feasible updates. The technique can be plugged in,as an add-on, to any first-order approximate unlearning methods. Experimentswith computer vision classifiers validate this approach.