Abstract
Recent advances in Generative Adversarial Networks (GANs) have led to theirwidespread adoption for the purposes of generating high quality syntheticimagery. While capable of generating photo-realistic images, these models oftenproduce unrealistic samples which fall outside of the data manifold. Severalrecently proposed techniques attempt to avoid spurious samples, either byrejecting them after generation, or by truncating the model's latent space.While effective, these methods are inefficient, as large portions of modelcapacity are dedicated towards representing samples that will ultimately gounused. In this work we propose a novel approach to improve sample quality:altering the training dataset via instance selection before model training hastaken place. To this end, we embed data points into a perceptual feature spaceand use a simple density model to remove low density regions from the datamanifold. By refining the empirical data distribution before training weredirect model capacity towards high-density regions, which ultimately improvessample fidelity. We evaluate our method by training a Self-Attention GAN onImageNet at 64x64 resolution, where we outperform the current state-of-the-artmodels on this task while using 1/2 of the parameters. We also highlighttraining time savings by training a BigGAN on ImageNet at 128x128 resolution,achieving a 66% increase in Inception Score and a 16% improvement in FID overthe baseline model with less than 1/4 the training time.