CITE: A Corpus of Image--Text Discourse Relations

  • 2019-04-12 15:46:31
  • Malihe Alikhani, Sreyasi Nag Chowdhury, Gerard de Melo, Matthew Stone
  • 4

Abstract

This paper presents a novel crowd-sourced resource for multimodal discourse:our resource characterizes inferences in image-text contexts in the domain ofcooking recipes in the form of coherence relations. Like previous corporaannotating discourse structure between text arguments, such as the PennDiscourse Treebank, our new corpus aids in establishing a better understandingof natural communication and common-sense reasoning, while our findings haveimplications for a wide range of applications, such as understanding andgeneration of multimodal documents.

 

Quick Read (beta)

loading the full paper ...