Towards Photographic Image Manipulation with Balanced Growing of Generative Autoencoders

  • 2020-02-20 18:36:05
  • Ari Heljakka, Arno Solin, Juho Kannala
  • 0

Abstract

We present a generative autoencoder that provides fast encoding, faithfulreconstructions (eg. retaining the identity of a face), sharpgenerated/reconstructed samples in high resolutions, and a well-structuredlatent space that supports semantic manipulation of the inputs. There are nocurrent autoencoder or GAN models that satisfactorily achieve all of these. Webuild on the progressively growing autoencoder model PIONEER, for which wecompletely alter the training dynamics based on a careful analysis of recentlyintroduced normalization schemes. We show significantly improved visual andquantitative results for face identity conservation in CelebAHQ. Our modelachieves state-of-the-art disentanglement of latent space, both quantitativelyand via realistic image attribute manipulations. On the LSUN Bedrooms dataset,we improve the disentanglement performance of the vanilla PIONEER, despitehaving a simpler model. Overall, our results indicate that the PIONEER networksprovide a way towards photorealistic face manipulation.

 

Quick Read (beta)

loading the full paper ...