Investigating the Timescales of Language Processing with EEG and Language Models

  • 2024-07-31 12:50:54
  • Davide Turco, Conor Houghton
  • 0

Abstract

This study explores the temporal dynamics of language processing by examiningthe alignment between word representations from a pre-trained transformer-basedlanguage model, and EEG data. Using a Temporal Response Function (TRF) model,we investigate how neural activity corresponds to model representations acrossdifferent layers, revealing insights into the interaction between artificiallanguage models and brain responses during language comprehension. Our analysisreveals patterns in TRFs from distinct layers, highlighting varyingcontributions to lexical and compositional processing. Additionally, we usedlinear discriminant analysis (LDA) to isolate part-of-speech (POS)representations, offering insights into their influence on neural responses andthe underlying mechanisms of syntactic processing. These findings underscoreEEG's utility for probing language processing dynamics with high temporalresolution. By bridging artificial language models and neural activity, thisstudy advances our understanding of their interaction at fine timescales.

 

Quick Read (beta)

loading the full paper ...