Abstract
Cognitive science and neuroscience have long faced the challenge ofdisentangling representations of language from representations of conceptualmeaning. As the same problem arises in today's language models (LMs), weinvestigate the relationship between LM--brain alignment and two neuralmetrics: (1) the level of brain activation during processing of sentences,targeting linguistic processing, and (2) a novel measure of meaning consistencyacross input modalities, which quantifies how consistently a brain regionresponds to the same concept across paradigms (sentence, word cloud, image)using an fMRI dataset (Pereira et al., 2018). Our experiments show that bothlanguage-only and language-vision models predict the signal better in moremeaning-consistent areas of the brain, even when these areas are not stronglysensitive to language processing, suggesting that LMs might internallyrepresent cross-modal conceptual meaning.