Abstract
We introduce a new architecture called a conditional invertible neuralnetwork (cINN), and use it to address the task of diverse image-to-imagetranslation for natural images. This is not easily possible with existing INNmodels due to some fundamental limitations. The cINN combines the purelygenerative INN model with an unconstrained feed-forward network, whichefficiently preprocesses the conditioning image into maximally informativefeatures. All parameters of a cINN are jointly optimized with a stable, maximumlikelihood-based training procedure. Even though INN-based models have receivedfar less attention in the literature than GANs, they have been shown to havesome remarkable properties absent in GANs, e.g. apparent immunity to modecollapse. We find that our cINNs leverage these properties for image-to-imagetranslation, demonstrated on day to night translation and image colorization.Furthermore, we take advantage of our bidirectional cINN architecture toexplore and manipulate emergent properties of the latent space, such aschanging the image style in an intuitive way.