Abstract
Language models can produce fluent, grammatical text. Nonetheless, somemaintain that language models don't really learn language and also that, evenif they did, that would not be informative for the study of human learning andprocessing. On the other side, there have been claims that the success of LMsobviates the need for studying linguistic theory and structure. We argue thatboth extremes are wrong. LMs can contribute to fundamental questions aboutlinguistic structure, language processing, and learning. They force us torethink arguments about learning and are informative for major questions inlinguistic theory. But they do not replace linguistic structure and theory. Weoffer an optimistic take on the relationship between language models andlinguistics.