Consistency Regularization for Generative Adversarial Networks

  • 2019-10-26 09:06:03
  • Han Zhang, Zizhao Zhang, Augustus Odena, Honglak Lee
  • 40


Generative Adversarial Networks (GANs) are known to be difficult to train,despite considerable research effort. Several regularization techniques forstabilizing training have been proposed, but they introduce non-trivialcomputational overheads and interact poorly with existing techniques likespectral normalization. In this work, we propose a simple, effective trainingstabilizer based on the notion of consistency regularization---a populartechnique in the semi-supervised learning literature. In particular, we augmentdata passing into the GAN discriminator and penalize the sensitivity of thediscriminator to these augmentations. We conduct a series of experiments todemonstrate that consistency regularization works effectively with spectralnormalization and various GAN architectures, loss functions and optimizersettings. Our method achieves the best FID scores for unconditional imagegeneration compared to other regularization methods on CIFAR-10 and CelebA.Moreover, Our consistency regularized GAN (CR-GAN) improves state-of-the-artFID scores for conditional generation from 14.73 to 11.67 on CIFAR-10 and from8.73 to 6.66 on ImageNet-2012.


Quick Read (beta)

loading the full paper ...