Regularizing Generative Adversarial Networks under Limited Data

  • 2021-04-07 17:59:06
  • Hung-Yu Tseng, Lu Jiang, Ce Liu, Ming-Hsuan Yang, Weilong Yang
  • 41

Abstract

Recent years have witnessed the rapid progress of generative adversarialnetworks (GANs). However, the success of the GAN models hinges on a largeamount of training data. This work proposes a regularization approach fortraining robust GAN models on limited data. We theoretically show a connectionbetween the regularized loss and an f-divergence called LeCam-divergence, whichwe find is more robust under limited training data. Extensive experiments onseveral benchmark datasets demonstrate that the proposed regularization scheme1) improves the generalization performance and stabilizes the learning dynamicsof GAN models under limited training data, and 2) complements the recent dataaugmentation methods. These properties facilitate training GAN models toachieve state-of-the-art performance when only limited training data of theImageNet benchmark is available.

 

Quick Read (beta)

loading the full paper ...