Abstract

We propose Score-of-Mixture Training (SMT), a novel framework for trainingone-step generative models by minimizing a class of divergences called the$\alpha$-skew Jensen-Shannon divergence. At its core, SMT estimates the scoreof mixture distributions between real and fake samples across multiple noiselevels. Similar to consistency models, our approach supports both training fromscratch (SMT) and distillation using a pretrained diffusion model, which wecall Score-of-Mixture Distillation (SMD). It is simple to implement, requiresminimal hyperparameter tuning, and ensures stable training. Experiments onCIFAR-10 and ImageNet 64x64 show that SMT/SMD are competitive with and can evenoutperform existing methods.

 

Quick Read (beta)