Abstract
Deep neural networks are data hungry models and thus they face difficultieswhen used for training on small size data. Transfer learning is a method thatcould potentially help in such situations. Although transfer learning achievedgreat success in image processing, its effect in the text domain is yet to bewell established especially due to several intricacies that arise in thecontext of document analysis and understanding. In this paper, we study theproblem of transfer learning for text summarization and discuss why theexisting state-of-the-art models for this problem fail to generalize well onother (unseen) datasets. We propose a reinforcement learning framework based onself-critic policy gradient method which solves this problem and achieves goodgeneralization and state-of-the-art results on a variety of datasets. Throughan extensive set of experiments, we also show the ability of our proposedframework in fine-tuning the text summarization model only with a few trainingsamples. To the best of our knowledge, this is first work that studies transferlearning in text summarization and provides a generic solution that works wellon unseen data.