A Simple Baseline for StyleGAN Inversion

  • 2021-04-15 17:59:49
  • Tianyi Wei, Dongdong Chen, Wenbo Zhou, Jing Liao, Weiming Zhang, Lu Yuan, Gang Hua, Nenghai Yu
  • 23

Abstract

This paper studies the problem of StyleGAN inversion, which plays anessential role in enabling the pretrained StyleGAN to be used for real facialimage editing tasks. This problem has the high demand for quality andefficiency. Existing optimization-based methods can produce high qualityresults, but the optimization often takes a long time. On the contrary,forward-based methods are usually faster but the quality of their results isinferior. In this paper, we present a new feed-forward network for StyleGANinversion, with significant improvement in terms of efficiency and quality. Inour inversion network, we introduce: 1) a shallower backbone with multipleefficient heads across scales; 2) multi-layer identity loss and multi-layerface parsing loss to the loss function; and 3) multi-stage refinement.Combining these designs together forms a simple and efficient baseline methodwhich exploits all benefits of optimization-based and forward-based methods.Quantitative and qualitative results show that our method performs better thanexisting forward-based methods and comparably to state-of-the-artoptimization-based methods, while maintaining the high efficiency as well asforward-based methods. Moreover, a number of real image editing applicationsdemonstrate the efficacy of our method. Our project page is~\url{https://wty-ustc.github.io/inversion}.

 

Quick Read (beta)

loading the full paper ...