Abstract
Efficiently updating multilingual knowledge in large language models (LLMs),while preserving consistent factual representations across languages, remains along-standing and unresolved challenge. While deploying separate editingsystems for each language might seem viable, this approach incurs substantialcosts due to the need to manage multiple models. A more efficient solutioninvolves integrating knowledge updates across all languages into a unifiedmodel. However, performing sequential edits across languages often leads todestructive parameter interference, significantly degrading multilingualgeneralization and the accuracy of injected knowledge. To address thischallenge, we propose LangEdit, a novel null-space constrained frameworkdesigned to precisely isolate language-specific knowledge updates. The coreinnovation of LangEdit lies in its ability to project parameter updates foreach language onto the orthogonal complement of previous updated subspaces.This approach mathematically guarantees update independence while preservingmultilingual generalization capabilities. We conduct a comprehensive evaluationacross three model architectures, six languages, and four downstream tasks,demonstrating that LangEdit effectively mitigates parameter interference andoutperforms existing state-of-the-art editing methods. Our results highlightits potential for enabling efficient and accurate multilingual knowledgeupdates in LLMs. The code is available athttps://github.com/VRCMF/LangEdit.git.