Abstract
Adversarially trained generative models (GANs) have recently achievedcompelling image synthesis results. But despite early successes in using GANsfor unsupervised representation learning, they have since been superseded byapproaches based on self-supervision. In this work we show that progress inimage generation quality translates to substantially improved representationlearning performance. Our approach, BigBiGAN, builds upon the state-of-the-artBigGAN model, extending it to representation learning by adding an encoder andmodifying the discriminator. We extensively evaluate the representationlearning and generation capabilities of these BigBiGAN models, demonstratingthat these generation-based models achieve the state of the art in unsupervisedrepresentation learning on ImageNet, as well as in unconditional imagegeneration.