An Iterative Polishing Framework based on Quality Aware Masked Language Model for Chinese Poetry Generation

  • 2019-11-29 16:34:00
  • Liming Deng, Jie Wang, Hangming Liang, Hui Chen, Zhiqiang Xie, Bojin Zhuang, Shaojun Wang, Jing Xiao
  • 3

Abstract

Owing to its unique literal and aesthetical characteristics, automaticgeneration of Chinese poetry is still challenging in Artificial Intelligence,which can hardly be straightforwardly realized by end-to-end methods. In thispaper, we propose a novel iterative polishing framework for highly qualifiedChinese poetry generation. In the first stage, an encoder-decoder structure isutilized to generate a poem draft. Afterwards, our proposed Quality-AwareMasked Language Model (QAMLM) is employed to polish the draft towards higherquality in terms of linguistics and literalness. Based on a multi-task learningscheme, QA-MLM is able to determine whether polishing is needed based on thepoem draft. Furthermore, QAMLM is able to localize improper characters of thepoem draft and substitute with newly predicted ones accordingly. Benefited fromthe masked language model structure, QAMLM incorporates global contextinformation into the polishing process, which can obtain more appropriatepolishing results than the unidirectional sequential decoding. Moreover, theiterative polishing process will be terminated automatically when QA-MLMregards the processed poem as a qualified one. Both human and automaticevaluation have been conducted, and the results demonstrate that our approachis effective to improve the performance of encoder-decoder structure.

 

Quick Read (beta)

loading the full paper ...