Abstract
In this paper, we describe the "implicit autoencoder" (IAE), a generativeautoencoder in which both the generative path and the recognition path areparametrized by implicit distributions. We use two generative adversarialnetworks to define the reconstruction and the regularization cost functions ofthe implicit autoencoder, and derive the learning rules based onmaximum-likelihood learning. Using implicit distributions allows us to learnmore expressive posterior and conditional likelihood distributions for theautoencoder. Learning an expressive conditional likelihood distribution enablesthe latent code to only capture the abstract and high-level information of thedata, while the remaining information is captured by the implicit conditionallikelihood distribution. For example, we show that implicit autoencoders candisentangle the global and local information, and perform deterministic orstochastic reconstructions of the images. We further show that implicitautoencoders can disentangle discrete underlying factors of variation from thecontinuous factors in an unsupervised fashion, and perform clustering andsemi-supervised learning.