Abstract

Transformer-based language models have shown to be very powerful for naturallanguage generation (NLG). However, text generation conditioned on some userinputs, such as topics or attributes, is non-trivial. Past approach relies oneither modifying the original LM architecture, re-training the LM on corporawith attribute labels, or having separately trained `guidance models' to guidetext generation in decoding. We argued that the above approaches are notnecessary, and the original unconditioned LM is sufficient for conditioned NLG.We evaluated our approaches by the samples' fluency and diversity withautomated and human evaluation.

 

Quick Read (beta)