Abstract
Invertible flow-based generative models are an effective method for learningto generate samples, while allowing for tractable likelihood computation andinference. However, the invertibility requirement restricts models to have thesame latent dimensionality as the inputs. This imposes significantarchitectural, memory, and computational costs, making them more challenging toscale than other classes of generative models such as Variational Autoencoders(VAEs). We propose a generative model based on probability flows that does awaywith the bijectivity requirement on the model and only assumes injectivity.This also provides another perspective on regularized autoencoders (RAEs), withour final objectives resembling RAEs with specific regularizers that arederived by lower bounding the probability flow objective. We empiricallydemonstrate the promise of the proposed model, improving over VAEs and AEs interms of sample quality.