Reddit Entity Linking Dataset

  • 2021-02-25 17:54:48
  • Nicholas Botzer, Yifan Ding, Tim Weninger
  • 0

Abstract

We introduce and make publicly available an entity linking dataset fromReddit that contains 17,316 linked entities, each annotated by three humanannotators and then grouped into Gold, Silver, and Bronze to indicateinter-annotator agreement. We analyze the different errors and disagreementsmade by annotators and suggest three types of corrections to the raw data.Finally, we tested existing entity linking models that are trained and tuned ontext from non-social media datasets. We find that, although these existingentity linking models perform very well on their original datasets, theyperform poorly on this social media dataset. We also show that the majority ofthese errors can be attributed to poor performance on the mention detectionsubtask. These results indicate the need for better entity linking models thatcan be applied to the enormous amount of social media text.

 

Quick Read (beta)

loading the full paper ...