Controllable Person Image Synthesis with Attribute-Decomposed GAN

  • 2020-03-27 07:47:06
  • Yifang Men, Yiming Mao, Yuning Jiang, Wei-Ying Ma, Zhouhui Lian
  • 50

Abstract

This paper introduces the Attribute-Decomposed GAN, a novel generative modelfor controllable person image synthesis, which can produce realistic personimages with desired human attributes (e.g., pose, head, upper clothes andpants) provided in various source inputs. The core idea of the proposed modelis to embed human attributes into the latent space as independent codes andthus achieve flexible and continuous control of attributes via mixing andinterpolation operations in explicit style representations. Specifically, a newarchitecture consisting of two encoding pathways with style block connectionsis proposed to decompose the original hard mapping into multiple moreaccessible subtasks. In source pathway, we further extract component layoutswith an off-the-shelf human parser and feed them into a shared global textureencoder for decomposed latent codes. This strategy allows for the synthesis ofmore realistic output images and automatic separation of un-annotatedattributes. Experimental results demonstrate the proposed method's superiorityover the state of the art in pose transfer and its effectiveness in thebrand-new task of component attribute transfer.

 

Quick Read (beta)

loading the full paper ...