StyleGAN-T: Unlocking the Power of GANs for Fast Large-Scale Text-to-Image Synthesis

  • 2023-01-23 16:05:45
  • Axel Sauer, Tero Karras, Samuli Laine, Andreas Geiger, Timo Aila
  • 44


Text-to-image synthesis has recently seen significant progress thanks tolarge pretrained language models, large-scale training data, and theintroduction of scalable model families such as diffusion and autoregressivemodels. However, the best-performing models require iterative evaluation togenerate a single sample. In contrast, generative adversarial networks (GANs)only need a single forward pass. They are thus much faster, but they currentlyremain far behind the state-of-the-art in large-scale text-to-image synthesis.This paper aims to identify the necessary steps to regain competitiveness. Ourproposed model, StyleGAN-T, addresses the specific requirements of large-scaletext-to-image synthesis, such as large capacity, stable training on diversedatasets, strong text alignment, and controllable variation vs. text alignmenttradeoff. StyleGAN-T significantly improves over previous GANs and outperformsdistilled diffusion models - the previous state-of-the-art in fasttext-to-image synthesis - in terms of sample quality and speed.


Quick Read (beta)

loading the full paper ...