Abstract
Sentential relation extraction (RE) is an important task in natural languageprocessing (NLP). In this paper we propose to do sentential RE with dynamicrouting in capsules. We first show that the proposed approach outperform stateof the art on common sentential relation extraction datasets Tacred, Tacredrev,Retacred, and Conll04. We then investigate potential reasons for its goodperformance on the mentioned datasets, and yet low performance on anothersimilar, yet larger sentential RE dataset, Wikidata. As such, we identify noisein Wikidata labels as one of the reasons that can hinder performance.Additionally, we show associativity of better performance with betterre-representation, a term from neuroscience referred to change ofrepresentation in human brain to improve the match at comparison time. Asexample, in the given analogous terms King:Queen::Man:Woman, at comparisontime, and as a result of re-representation, the similarity between related headterms (King,Man), and tail terms (Queen,Woman) increases. As such, ourobservation show that our proposed model can do re-representation better thanthe vanilla model compared with. To that end, beside noise in the labels of thedistantly supervised RE datasets, we propose re-representation as a challengein sentential RE.