Convergence Analysis of Probability Flow ODE for Score-based Generative Models

  • 2024-04-15 13:29:28
  • Daniel Zhengyu Huang, Jiaoyang Huang, Zhengjiang Lin
  • 0

Abstract

Score-based generative models have emerged as a powerful approach forsampling high-dimensional probability distributions. Despite theireffectiveness, their theoretical underpinnings remain relativelyunderdeveloped. In this work, we study the convergence properties ofdeterministic samplers based on probability flow ODEs from both theoretical andnumerical perspectives. Assuming access to $L^2$-accurate estimates of thescore function, we prove the total variation between the target and thegenerated data distributions can be bounded above by$\mathcal{O}(d\sqrt{\delta})$ in the continuous time level, where $d$ denotesthe data dimension and $\delta$ represents the $L^2$-score matching error. Forpractical implementations using a $p$-th order Runge-Kutta integrator with stepsize $h$, we establish error bounds of $\mathcal{O}(d(\sqrt{\delta} + (dh)^p))$at the discrete level. Finally, we present numerical studies on problems up to$128$ dimensions to verify our theory, which indicate a better score matchingerror and dimension dependence.

 

Quick Read (beta)

loading the full paper ...