Augmenting Neural Networks with First-order Logic

  • 2019-08-12 16:14:28
  • Tao Li, Vivek Srikumar
  • 0

Abstract

Today, the dominant paradigm for training neural networks involves minimizingtask loss on a large dataset. Using world knowledge to inform a model, and yetretain the ability to perform end-to-end training remains an open question. Inthis paper, we present a novel framework for introducing declarative knowledgeto neural network architectures in order to guide training and prediction. Ourframework systematically compiles logical statements into computation graphsthat augment a neural network without extra learnable parameters or manualredesign. We evaluate our modeling strategy on three tasks: machinecomprehension, natural language inference, and text chunking. Our experimentsshow that knowledge-augmented networks can strongly improve over baselines,especially in low-data regimes.

 

Quick Read (beta)

loading the full paper ...