Self-Supervised Generative Adversarial Networks

  • 2018-11-27 19:30:40
  • Ting Chen, Xiaohua Zhai, Marvin Ritter, Mario Lucic, Neil Houlsby
  • 39

Abstract

Conditional GANs are at the forefront of natural image synthesis. The maindrawback of such models is the necessity for labelled data. In this work weexploit two popular unsupervised learning techniques, adversarial training andself-supervision, to close the gap between conditional and unconditional GANs.In particular, we allow the networks to collaborate on the task ofrepresentation learning, while being adversarial with respect to the classicGAN game. The role of self-supervision is to encourage the discriminator tolearn meaningful feature representations which are not forgotten duringtraining. We test empirically both the quality of the learned imagerepresentations, and the quality of the synthesized images. Under the sameconditions, the self-supervised GAN attains a similar performance tostate-of-the-art conditional counterparts. Finally, we show that this approachto fully unsupervised learning can be scaled to attain an FID of 33 onunconditional ImageNet generation.

 

Quick Read (beta)

loading the full paper ...