Abstract
Abstractive summarization has been studied using neural sequence transductionmethods with datasets of large, paired document-summary examples. However, suchdatasets are rare and the models trained from them do not generalize to otherdomains. Recently, some progress has been made in learning sequence-to-sequencemappings with only unpaired examples. In our work, we consider the settingwhere there are only documents and no summaries provided and propose anend-to-end, neural model architecture to perform unsupervised abstractivesummarization. Our proposed model consists of an auto-encoder trained so thatthe mean of the representations of the input documents decodes to a reasonablesummary. We consider variants of the proposed architecture and perform anablation study to show the importance of specific components. We apply ourmodel to the summarization of business and product reviews and show that thegenerated summaries are fluent, show relevancy in terms of word-overlap,representative of the average sentiment of the input documents, and are highlyabstractive compared to baselines.