Abstract

This paper proposes a new type of generative model that is able to quicklylearn a latent representation without an encoder. This is achieved byinitialising a latent vector with zeros, then using gradients of the datafitting loss with respect to this zero vector as new latent points. Theapproach has similar characteristics to autoencoders but with a simplernaturally balanced architecture, and is demonstrated in a variationalautoencoder equivalent that permits sampling. This also allows implicitrepresentation networks to learn a space of implicit functions withoutrequiring a hypernetwork, retaining their representation advantages with fewerparameters.

 

Quick Read (beta)