Abstract
One of the roadblocks to a better understanding of neural networks' internalsis \textit{polysemanticity}, where neurons appear to activate in multiple,semantically distinct contexts. Polysemanticity prevents us from identifyingconcise, human-understandable explanations for what neural networks are doinginternally. One hypothesised cause of polysemanticity is\textit{superposition}, where neural networks represent more features than theyhave neurons by assigning features to an overcomplete set of directions inactivation space, rather than to individual neurons. Here, we attempt toidentify those directions, using sparse autoencoders to reconstruct theinternal activations of a language model. These autoencoders learn sets ofsparsely activating features that are more interpretable and monosemantic thandirections identified by alternative approaches, where interpretability ismeasured by automated methods. Ablating these features enables precise modelediting, for example, by removing capabilities such as pronoun prediction,while disrupting model behaviour less than prior techniques. This workindicates that it is possible to resolve superposition in language models usinga scalable, unsupervised method. Our method may serve as a foundation forfuture mechanistic interpretability work, which we hope will enable greatermodel transparency and steerability.