VOGUE: Try-On by StyleGAN Interpolation Optimization

  • 2021-01-06 22:01:46
  • Kathleen M Lewis, Srivatsan Varadharajan, Ira Kemelmacher-Shlizerman
  • 177

Abstract

Given an image of a target person and an image of another person wearing agarment, we automatically generate the target person in the given garment. Atthe core of our method is a pose-conditioned StyleGAN2 latent spaceinterpolation, which seamlessly combines the areas of interest from each image,i.e., body shape, hair, and skin color are derived from the target person,while the garment with its folds, material properties, and shape comes from thegarment image. By automatically optimizing for interpolation coefficients perlayer in the latent space, we can perform a seamless, yet true to source,merging of the garment and target person. Our algorithm allows for garments todeform according to the given body shape, while preserving pattern and materialdetails. Experiments demonstrate state-of-the-art photo-realistic results athigh resolution ($512\times 512$).

 

Quick Read (beta)

loading the full paper ...