Abstract
Large language models (LLMs) have demonstrated impressive capabilities acrossa variety of tasks, but their increasing autonomy in real-world applicationsraises concerns about their trustworthiness. While hallucinations-unintentionalfalsehoods-have been widely studied, the phenomenon of lying, where an LLMknowingly generates falsehoods to achieve an ulterior objective, remainsunderexplored. In this work, we systematically investigate the lying behaviorof LLMs, differentiating it from hallucinations and testing it in practicalscenarios. Through mechanistic interpretability techniques, we uncover theneural mechanisms underlying deception, employing logit lens analysis, causalinterventions, and contrastive activation steering to identify and controldeceptive behavior. We study real-world lying scenarios and introducebehavioral steering vectors that enable fine-grained manipulation of lyingtendencies. Further, we explore the trade-offs between lying and end-taskperformance, establishing a Pareto frontier where dishonesty can enhance goaloptimization. Our findings contribute to the broader discourse on AI ethics,shedding light on the risks and potential safeguards for deploying LLMs inhigh-stakes environments. Code and more illustrations are available athttps://llm-liar.github.io/