Learning beyond datasets: Knowledge Graph Augmented Neural Networks for Natural language Processing

  • 2018-05-21 03:44:48
  • K M Annervaz, Somnath Basu Roy Chowdhury, Ambedkar Dukkipati
  • 0

Abstract

Machine Learning has been the quintessential solution for many AI problems,but learning is still heavily dependent on the specific training data. Somelearning models can be incorporated with a prior knowledge in the Bayesian setup, but these learning models do not have the ability to access any organisedworld knowledge on demand. In this work, we propose to enhance learning modelswith world knowledge in the form of Knowledge Graph (KG) fact triples forNatural Language Processing (NLP) tasks. Our aim is to develop a deep learningmodel that can extract relevant prior support facts from knowledge graphsdepending on the task using attention mechanism. We introduce aconvolution-based model for learning representations of knowledge graph entityand relation clusters in order to reduce the attention space. We show that theproposed method is highly scalable to the amount of prior information that hasto be processed and can be applied to any generic NLP task. Using this methodwe show significant improvement in performance for text classification withNews20, DBPedia datasets and natural language inference with Stanford NaturalLanguage Inference (SNLI) dataset. We also demonstrate that a deep learningmodel can be trained well with substantially less amount of labeled trainingdata, when it has access to organised world knowledge in the form of knowledgegraph.

 

Quick Read (beta)

loading the full paper ...