Image-to-image translation for cross-domain disentanglement

  • 2018-05-24 15:30:23
  • Abel Gonzalez-Garcia, Joost van de Weijer, Yoshua Bengio
  • 15

Abstract

Deep image translation methods have recently shown excellent results,outputting high-quality images covering multiple modes of the datadistribution. There has also been increased interest in disentangling theinternal representations learned by deep methods to further improve theirperformance and achieve a finer control. In this paper, we bridge these twoobjectives and introduce the concept of cross-domain disentanglement. We aim toseparate the internal representation into three parts. The shared part containsinformation for both domains. The exclusive parts, on the other hand, containonly factors of variation that are particular to each domain. We achieve thisthrough bidirectional image translation based on Generative AdversarialNetworks and cross-domain autoencoders, a novel network component. The obtainedmodel offers multiple advantages. We can output diverse samples coveringmultiple modes of the distributions of both domains. We can performcross-domain retrieval without the need of labeled data. Finally, we canperform domain-specific image transfer and interpolation. We compare our modelto the state-of-the-art in multi-modal image translation and achieve betterresults.

 

Quick Read (beta)

loading the full paper ...