Abstract
As neural networks become dominant in essential systems, ExplainableArtificial Intelligence (XAI) plays a crucial role in fostering trust anddetecting potential misbehavior of opaque models. LIME (Local InterpretableModel-agnostic Explanations) is among the most prominent model-agnosticapproaches, generating explanations by approximating the behavior of black-boxmodels around specific instances. Despite its popularity, LIME faces challengesrelated to fidelity, stability, and applicability to domain-specific problems.Numerous adaptations and enhancements have been proposed to address theseissues, but the growing number of developments can be overwhelming,complicating efforts to navigate LIME-related research. To the best of ourknowledge, this is the first survey to comprehensively explore and collectLIME's foundational concepts and known limitations. We categorize and compareits various enhancements, offering a structured taxonomy based on intermediatesteps and key issues. Our analysis provides a holistic overview of advancementsin LIME, guiding future research and helping practitioners identify suitableapproaches. Additionally, we provide a continuously updated interactive website(https://patrick-knab.github.io/which-lime-to-trust/), offering a concise andaccessible overview of the survey.