Abstract
The locate-then-edit paradigm has shown significant promise for knowledgeediting (KE) in Large Language Models (LLMs). While previous methods performwell on single-hop fact recall tasks, they consistently struggle with multi-hopfactual recall tasks involving newly edited knowledge. In this paper,leveraging tools in mechanistic interpretability, we first identify that inmulti-hop tasks, LLMs tend to retrieve implicit subject knowledge from deeperMLP layers, unlike single-hop tasks, which rely on earlier layers. Thisdistinction explains the poor performance of current methods in multi-hopqueries, as they primarily focus on editing shallow layers, leaving deeperlayers unchanged. To address this, we propose IFMET, a novel locate-then-editKE approach designed to edit both shallow and deep MLP layers. IFMET employsmulti-hop editing prompts and supplementary sets to locate and modify knowledgeacross different reasoning stages. Experimental results demonstrate that IFMETsignificantly improves performance on multi-hop factual recall tasks,effectively overcoming the limitations of previous locate-then-edit methods.