ChatPainter: Improving Text to Image Generation using Dialogue

  • 2018-02-22 18:15:40
  • Shikhar Sharma, Dendi Suhubdy, Vincent Michalski, Samira Ebrahimi Kahou, Yoshua Bengio
  • 58

Abstract

Synthesizing realistic images from text descriptions on a dataset likeMicrosoft Common Objects in Context (MS COCO), where each image can containseveral objects, is a challenging task. Prior work has used text captions togenerate images. However, captions might not be informative enough to capturethe entire image and insufficient for the model to be able to understand whichobjects in the images correspond to which words in the captions. We show thatadding a dialogue that further describes the scene leads to significantimprovement in the inception score and in the quality of generated images onthe MS COCO dataset.

 

Quick Read (beta)

loading the full paper ...