Why Do Neural Dialog Systems Generate Short and Meaningless Replies? A Comparison between Dialog and Translation

  • 2017-12-06 16:00:45
  • Bolin Wei, Shuai Lu, Lili Mou, Hao Zhou, Pascal Poupart, Ge Li, Zhi Jin
  • 3


This paper addresses the question: Why do neural dialog systems generateshort and meaningless replies? We conjecture that, in a dialog system, anutterance may have multiple equally plausible replies, causing the deficiencyof neural networks in the dialog application. We propose a systematic way tomimic the dialog scenario in a machine translation system, and manage toreproduce the phenomenon of generating short and less meaningful sentences inthe translation setting, showing evidence of our conjecture.


Introduction (beta)



Conclusion (beta)