From Reflection to Perfection: Scaling Inference-Time Optimization for Text-to-Image Diffusion Models via Reflection Tuning

  • 2025-04-22 18:58:07
  • Le Zhuo, Liangbing Zhao, Sayak Paul, Yue Liao, Renrui Zhang, Yi Xin, Peng Gao, Mohamed Elhoseiny, Hongsheng Li
  • 0

Abstract

Recent text-to-image diffusion models achieve impressive visual qualitythrough extensive scaling of training data and model parameters, yet they oftenstruggle with complex scenes and fine-grained details. Inspired by theself-reflection capabilities emergent in large language models, we proposeReflectionFlow, an inference-time framework enabling diffusion models toiteratively reflect upon and refine their outputs. ReflectionFlow introducesthree complementary inference-time scaling axes: (1) noise-level scaling tooptimize latent initialization; (2) prompt-level scaling for precise semanticguidance; and most notably, (3) reflection-level scaling, which explicitlyprovides actionable reflections to iteratively assess and correct previousgenerations. To facilitate reflection-level scaling, we construct GenRef, alarge-scale dataset comprising 1 million triplets, each containing areflection, a flawed image, and an enhanced image. Leveraging this dataset, weefficiently perform reflection tuning on state-of-the-art diffusiontransformer, FLUX.1-dev, by jointly modeling multimodal inputs within a unifiedframework. Experimental results show that ReflectionFlow significantlyoutperforms naive noise-level scaling methods, offering a scalable andcompute-efficient solution toward higher-quality image synthesis on challengingtasks.

 

Quick Read (beta)

loading the full paper ...