Vector Quantized Image-to-Image Translation

  • 2022-07-27 05:22:29
  • Yu-Jie Chen, Shin-I Cheng, Wei-Chen Chiu, Hung-Yu Tseng, Hsin-Ying Lee
  • 32


Current image-to-image translation methods formulate the task withconditional generation models, leading to learning only the recolorization orregional changes as being constrained by the rich structural informationprovided by the conditional contexts. In this work, we propose introducing thevector quantization technique into the image-to-image translation framework.The vector quantized content representation can facilitate not only thetranslation, but also the unconditional distribution shared among differentdomains. Meanwhile, along with the disentangled style representation, theproposed method further enables the capability of image extension withflexibility in both intra- and inter-domains. Qualitative and quantitativeexperiments demonstrate that our framework achieves comparable performance tothe state-of-the-art image-to-image translation and image extension methods.Compared to methods for individual tasks, the proposed method, as a unifiedframework, unleashes applications combining image-to-image translation,unconditional generation, and image extension altogether. For example, itprovides style variability for image generation and extension, and equipsimage-to-image translation with further extension capabilities.


Quick Read (beta)

loading the full paper ...