Gradient Origin Networks

  • 2020-07-30 17:18:20
  • Sam Bond-Taylor, Chris G. Willcocks
  • 0


This paper proposes a new type of generative model that is able to quicklylearn a latent representation without an encoder. This is achieved byinitialising a latent vector with zeros, then using gradients of the datafitting loss with respect to this zero vector as new latent points. Theapproach has similar characteristics to autoencoders but with a simplernaturally balanced architecture, and is demonstrated in a variationalautoencoder equivalent that permits sampling. This also allows implicitrepresentation networks to learn a space of implicit functions withoutrequiring a hypernetwork, retaining their representation advantages with fewerparameters.


Quick Read (beta)

loading the full paper ...