UNIT-DDPM: UNpaired Image Translation with Denoising Diffusion Probabilistic Models

  • 2021-04-12 11:22:56
  • Hiroshi Sasaki, Chris G. Willcocks, Toby P. Breckon
  • 26

Abstract

We propose a novel unpaired image-to-image translation method that usesdenoising diffusion probabilistic models without requiring adversarialtraining. Our method, UNpaired Image Translation with Denoising DiffusionProbabilistic Models (UNIT-DDPM), trains a generative model to infer the jointdistribution of images over both domains as a Markov chain by minimising adenoising score matching objective conditioned on the other domain. Inparticular, we update both domain translation models simultaneously, and wegenerate target domain images by a denoising Markov Chain Monte Carlo approachthat is conditioned on the input source domain images, based on Langevindynamics. Our approach provides stable model training for image-to-imagetranslation and generates high-quality image outputs. This enablesstate-of-the-art Fr\'echet Inception Distance (FID) performance on severalpublic datasets, including both colour and multispectral imagery, significantlyoutperforming the contemporary adversarial image-to-image translation methods.

 

Quick Read (beta)

loading the full paper ...