Why Do Neural Dialog Systems Generate Short and Meaningless Replies? A Comparison between Dialog and Translation

  • 2017-12-06 16:00:45
  • Bolin Wei, Shuai Lu, Lili Mou, Hao Zhou, Pascal Poupart, Ge Li, Zhi Jin
  • 4

Abstract

This paper addresses the question: Why do neural dialog systems generateshort and meaningless replies? We conjecture that, in a dialog system, anutterance may have multiple equally plausible replies, causing the deficiencyof neural networks in the dialog application. We propose a systematic way tomimic the dialog scenario in a machine translation system, and manage toreproduce the phenomenon of generating short and less meaningful sentences inthe translation setting, showing evidence of our conjecture.

 

Quick Read (beta)

loading the full paper ...