Limitations in learning an interpreted language with recurrent models

  • 2018-09-11 19:52:44
  • Denis Paperno
  • 6

Abstract

In this submission I report work in progress on learning simplifiedinterpreted languages by means of recurrent models. The data is constructed toreflect core properties of natural language as modeled in formal syntax andsemantics: recursive syntactic structure and compositionality. Preliminaryresults suggest that LSTM networks do generalise to compositionalinterpretation, albeit only in the most favorable learning setting, with awell-paced curriculum, extensive training data, and left-to-right (but notright-to-left) composition.

 

Quick Read (beta)

loading the full paper ...