Abstract
Obtaining valuable information from massive data efficiently has become ourresearch goal in the era of Big Data. Text summarization technology has beencontinuously developed to meet this demand. Recent work has also shown thattransformer-based pre-trained language models have achieved great success onvarious tasks in Natural Language Processing (NLP). Aiming at the problem ofChinese news text summary generation and the application of Transformerstructure on Chinese, this paper proposes a Chinese news text summarizationmodel (CNsum) based on Transformer structure, and tests it on Chinese datasetssuch as THUCNews. The results of the conducted experiments show that CNsumachieves better ROUGE score than the baseline models, which verifies theoutperformance of the model.