Abstract
The performance of generative adversarial networks (GANs) heavilydeteriorates given a limited amount of training data. This is mainly becausethe discriminator is memorizing the exact training set. To combat it, wepropose Differentiable Augmentation (DiffAugment), a simple method thatimproves the data efficiency of GANs by imposing various types ofdifferentiable augmentations on both real and fake samples. Previous attemptsto directly augment the training data manipulate the distribution of realimages, yielding little benefit; DiffAugment enables us to adopt thedifferentiable augmentation for the generated samples, effectively stabilizestraining, and leads to better convergence. Experiments demonstrate consistentgains of our method over a variety of GAN architectures and loss functions forboth unconditional and class-conditional generation. With DiffAugment, weachieve a state-of-the-art FID of 6.80 with an IS of 100.8 on ImageNet 128x128.Furthermore, with only 20% training data, we can match the top performance onCIFAR-10 and CIFAR-100. Finally, our method can generate high-fidelity imagesusing only 100 images without pre-training, while being on par with existingtransfer learning algorithms. Code is available athttps://github.com/mit-han-lab/data-efficient-gans.