Abstract
Producing diverse and realistic images with generative models such as GANstypically requires large scale training with vast amount of images. GANstrained with extremely limited data can easily overfit to few training samplesand display undesirable properties like "stairlike" latent space wheretransitions in latent space suffer from discontinuity, occasionally yieldingabrupt changes in outputs. In this work, we consider the situation whereneither large scale dataset of our interest nor transferable source dataset isavailable, and seek to train existing generative models with minimaloverfitting and mode collapse. We propose latent mixup-based distanceregularization on the feature space of both a generator and the counterpartdiscriminator that encourages the two players to reason not only about thescarce observed data points but the relative distances in the feature spacethey reside. Qualitative and quantitative evaluation on diverse datasetsdemonstrates that our method is generally applicable to existing models toenhance both fidelity and diversity under the constraint of limited data. Codewill be made public.