Abstract
Applications such as textual entailment, plagiarism detection or documentclustering rely on the notion of semantic similarity, and are usuallyapproached with dimension reduction techniques like LDA or with embedding-basedneural approaches. We present a scenario where semantic similarity is notenough, and we devise a neural approach to learn semantic relatedness. Thescenario is text spotting in the wild, where a text in an image (e.g. streetsign, advertisement or bus destination) must be identified and recognized. Ourgoal is to improve the performance of vision systems by leveraging semanticinformation. Our rationale is that the text to be spotted is often related tothe image context in which it appears (word pairs such as Delta-airplane, orquarters-parking are not similar, but are clearly related). We show howlearning a word-to-word or word-to-sentence relatedness score can improve theperformance of text spotting systems up to 2.9 points, outperforming othermeasures in a benchmark dataset.