SLGAN: Style- and Latent-guided Generative Adversarial Network for Desirable Makeup Transfer and Removal

  • 2020-09-16 08:54:20
  • Daichi Horita, Kiyoharu Aizawa
  • 19

Abstract

There are five features to consider when using generative adversarialnetworks to apply makeup to photos of the human face. These features include(1) facial components, (2) interactive color adjustments, (3) makeupvariations, (4) robustness to poses and expressions, and the (5) use ofmultiple reference images. Several related works have been proposed, mainlyusing generative adversarial networks (GAN). Unfortunately, none of them haveaddressed all five features simultaneously. This paper closes the gap with aninnovative style- and latent-guided GAN (SLGAN). We provide a novel, perceptualmakeup loss and a style-invariant decoder that can transfer makeup styles basedon histogram matching to avoid the identity-shift problem. In our experiments,we show that our SLGAN is better than or comparable to state-of-the-artmethods. Furthermore, we show that our proposal can interpolate facial makeupimages to determine the unique features, compare existing methods, and helpusers find desirable makeup configurations.

 

Quick Read (beta)

loading the full paper ...