Abstract
What information from an act of sentence understanding is robustlyrepresented in the human brain? We investigate this question by comparingsentence encoding models on a brain decoding task, where the sentence that anexperimental participant has seen must be predicted from the fMRI signal evokedby the sentence. We take a pre-trained BERT architecture as a baseline sentenceencoding model and fine-tune it on a variety of natural language understanding(NLU) tasks, asking which lead to improvements in brain-decoding performance. We find that none of the sentence encoding tasks tested yield significantincreases in brain decoding performance. Through further task ablations andrepresentational analyses, we find that tasks which produce syntax-lightrepresentations yield significant improvements in brain decoding performance.Our results constrain the space of NLU models that could best account for humanneural representations of language, but also suggest limits on the possibilityof decoding fine-grained syntactic information from fMRI human neuroimaging.