Exploring Neural Models for Parsing Natural Language into First-Order Logic

  • 2020-02-16 09:22:32
  • Hrituraj Singh, Milan Aggrawal, Balaji Krishnamurthy
  • 4

Abstract

Semantic parsing is the task of obtaining machine-interpretablerepresentations from natural language text. We consider one such formalrepresentation - First-Order Logic (FOL) and explore the capability of neuralmodels in parsing English sentences to FOL. We model FOL parsing as a sequenceto sequence mapping task where given a natural language sentence, it is encodedinto an intermediate representation using an LSTM followed by a decoder whichsequentially generates the predicates in the corresponding FOL formula. Weimprove the standard encoder-decoder model by introducing a variable alignmentmechanism that enables it to align variables across predicates in the predictedFOL. We further show the effectiveness of predicting the category of FOL entity- Unary, Binary, Variables and Scoped Entities, at each decoder step as anauxiliary task on improving the consistency of generated FOL. We performrigorous evaluations and extensive ablations. We also aim to release our codeas well as large scale FOL dataset along with models to aid further research inlogic-based parsing and inference in NLP.

 

Quick Read (beta)

loading the full paper ...