Collaging Class-specific GANs for Semantic Image Synthesis

  • 2021-10-08 17:46:56
  • Yuheng Li, Yijun Li, Jingwan Lu, Eli Shechtman, Yong Jae Lee, Krishna Kumar Singh
  • 27

Abstract

We propose a new approach for high resolution semantic image synthesis. Itconsists of one base image generator and multiple class-specific generators.The base generator generates high quality images based on a segmentation map.To further improve the quality of different objects, we create a bank ofGenerative Adversarial Networks (GANs) by separately training class-specificmodels. This has several benefits including -- dedicated weights for eachclass; centrally aligned data for each model; additional training data fromother sources, potential of higher resolution and quality; and easymanipulation of a specific object in the scene. Experiments show that ourapproach can generate high quality images in high resolution while havingflexibility of object-level control by using class-specific generators.

 

Quick Read (beta)

loading the full paper ...