Modern Methods for Text Generation

  • 2020-09-10 16:17:10
  • Dimas Munoz Montesinos
  • 115

Abstract

Synthetic text generation is challenging and has limited success. Recently, anew architecture, called Transformers, allow machine learning models tounderstand better sequential data, such as translation or summarization. BERTand GPT-2, using Transformers in their cores, have shown a great performance intasks such as text classification, translation and NLI tasks. In this article,we analyse both algorithms and compare their output quality in text generationtasks.

 

Quick Read (beta)

loading the full paper ...