Generative networks as inverse problems with Scattering transforms

  • 2018-05-17 07:12:18
  • Tomás Angles, Stéphane Mallat
  • 23

Abstract

Generative Adversarial Nets (GANs) and Variational Auto-Encoders (VAEs)provide impressive image generations from Gaussian white noise, but theunderlying mathematics are not well understood. We compute deep convolutionalnetwork generators by inverting a fixed embedding operator. Therefore, they donot require to be optimized with a discriminator or an encoder. The embeddingis Lipschitz continuous to deformations so that generators transform linearinterpolations between input white noise vectors into deformations betweenoutput images. This embedding is computed with a wavelet Scattering transform.Numerical experiments demonstrate that the resulting Scattering generators havesimilar properties as GANs or VAEs, without learning a discriminative networkor an encoder.

 

Quick Read (beta)

loading the full paper ...