Abstract

NLP is deeply intertwined with the formal study of language, bothconceptually and historically. Arguably, this connection goes all the way backto Chomsky's Syntactic Structures in 1957. This still holds true today, with astrand of recent works building formal analysis of modern neural networksmethods in terms of formal languages. In this document, I aim to explainbackground about formal languages as they relate to to this recent work. I willby necessity ignore large parts of the rich history of this field, insteadfocusing on presenting formal language theoretic concepts from the perspectiveof modern deep learning-based NLP.

 

Quick Read (beta)