Abstract
The growing legal and ethical scrutiny of large language models (LLMs)necessitates effective machine unlearning, particularly for sensitive orunauthorized data. Existing empirical methods often yield incomplete forgettingor unintended degradation of unrelated knowledge due to poor localization. Inthis work, we propose GRIN: a modular and targeted framework for LLMunlearning. GRIN introduces a novel gradient-ratio-based metric to identifyparameters most responsible for memorizing forget data. We then performselective noise injection into these parameters prior to fine-tuning, whichimproves unlearning performance while maintaining model utility. Finally, wepropose new evaluation metrics tailored to the LLM setting and validate ourapproach on standard benchmarks such as TOFU, WMDP, and SafePKU.