Abstract

Synthetic text generation is challenging and has limited success. Recently, anew architecture, called Transformers, allow machine learning models tounderstand better sequential data, such as translation or summarization. BERTand GPT-2, using Transformers in their cores, have shown a great performance intasks such as text classification, translation and NLI tasks. In this article,we analyse both algorithms and compare their output quality in text generationtasks.

 

Quick Read (beta)