GAN-Control: Explicitly Controllable GANs

  • 2021-01-07 10:54:17
  • Alon Shoshan, Nadav Bhonker, Igor Kviatkovsky, Gerard Medioni
  • 96

Abstract

We present a framework for training GANs with explicit control over generatedimages. We are able to control the generated image by settings exact attributessuch as age, pose, expression, etc. Most approaches for editing GAN-generatedimages achieve partial control by leveraging the latent space disentanglementproperties, obtained implicitly after standard GAN training. Such methods areable to change the relative intensity of certain attributes, but not explicitlyset their values. Recently proposed methods, designed for explicit control overhuman faces, harness morphable 3D face models to allow fine-grained controlcapabilities in GANs. Unlike these methods, our control is not constrained tomorphable 3D face model parameters and is extendable beyond the domain of humanfaces. Using contrastive learning, we obtain GANs with an explicitlydisentangled latent space. This disentanglement is utilized to traincontrol-encoders mapping human-interpretable inputs to suitable latent vectors,thus allowing explicit control. In the domain of human faces we demonstratecontrol over identity, age, pose, expression, hair color and illumination. Wealso demonstrate control capabilities of our framework in the domains ofpainted portraits and dog image generation. We demonstrate that our approachachieves state-of-the-art performance both qualitatively and quantitatively.

 

Quick Read (beta)

loading the full paper ...