Abstract
Modern recommender systems powered by Graph Neural Networks (GNNs) excel atmodeling complex user-item interactions, yet increasingly face scenariosrequiring selective forgetting of training data. Beyond user requests to removespecific interactions due to privacy concerns or preference changes, regulatoryframeworks mandate recommender systems' ability to eliminate the influence ofcertain user data from models. This recommendation unlearning challengepresents unique difficulties as removing connections within interaction graphscreates ripple effects throughout the model, potentially impactingrecommendations for numerous users. Traditional approaches suffer fromsignificant drawbacks: fragmentation methods damage graph structure anddiminish performance, while influence function techniques make assumptions thatmay not hold in complex GNNs, particularly with self-supervised or randomarchitectures. To address these limitations, we propose a novel model-agnosticpre-training paradigm UnlearnRec that prepares systems for efficient unlearningoperations. Our Influence Encoder takes unlearning requests together withexisting model parameters and directly produces updated parameters of unlearnedmodel with little fine-tuning, avoiding complete retraining while preservingmodel performance characteristics. Extensive evaluation on public benchmarksdemonstrates that our method delivers exceptional unlearning effectivenesswhile providing more than 10x speedup compared to retraining approaches. Werelease our method implementation at: https://github.com/HKUDS/UnlearnRec.