KGCleaner : Identifying and Correcting Errors Produced by Information Extraction Systems

  • 2018-08-14 17:55:13
  • Ankur Padia, Frank Ferraro, Tim Finin
  • 6

Abstract

KGCleaner is a framework to \emph{identify} and \emph{correct} errors in dataproduced and delivered by an information extraction system. These tasks havebeen understudied and KGCleaner is the first to address both. We introduce amulti-task model that jointly learns to predict if an extracted relation iscredible and repair it if not. We evaluate our approach and other models asinstance of our framework on two collections: a Wikidata corpus of nearly 700Kfacts and 5M fact-relevant sentences and a collection of 30K facts from the2015 TAC Knowledge Base Population task. For credibility classification,parameter efficient simple shallow neural network can achieve an absoluteperformance gain of 30 $F_1$ points on Wikidata and comparable performance onTAC. For the repair task, significant performance (at more than twice) gain canbe obtained depending on the nature of the dataset and the models.

 

Quick Read (beta)

loading the full paper ...