SEAN: Image Synthesis with Semantic Region-Adaptive Normalization

  • 2019-11-28 20:54:35
  • Peihao Zhu, Rameen Abdal, Yipeng Qin, Peter Wonka
  • 47

Abstract

We propose semantic region-adaptive normalization (SEAN), a simple buteffective building block for Generative Adversarial Networks conditioned onsegmentation masks that describe the semantic regions in the desired outputimage. Using SEAN normalization, we can build a network architecture that cancontrol the style of each semantic region individually, e.g., we can specifyone style reference image per region. SEAN is better suited to encode,transfer, and synthesize style than the best previous method in terms ofreconstruction quality, variability, and visual quality. We evaluate SEAN onmultiple datasets and report better quantitative metrics (e.g. FID, PSNR) thanthe current state of the art. SEAN also pushes the frontier of interactiveimage editing. We can interactively edit images by changing segmentation masksor the style for any given region. We can also interpolate styles from tworeference images per region.

 

Quick Read (beta)

loading the full paper ...