MagCache: Fast Video Generation with Magnitude-Aware Cache

  • 2025-06-10 18:59:02
  • Zehong Ma, Longhui Wei, Feng Wang, Shiliang Zhang, Qi Tian
  • 0

Abstract

Existing acceleration techniques for video diffusion models often rely onuniform heuristics or time-embedding variants to skip timesteps and reusecached features. These approaches typically require extensive calibration withcurated prompts and risk inconsistent outputs due to prompt-specificoverfitting. In this paper, we introduce a novel and robust discovery: aunified magnitude law observed across different models and prompts.Specifically, the magnitude ratio of successive residual outputs decreasesmonotonically and steadily in most timesteps while rapidly in the last severalsteps. Leveraging this insight, we introduce a Magnitude-aware Cache (MagCache)that adaptively skips unimportant timesteps using an error modeling mechanismand adaptive caching strategy. Unlike existing methods requiring dozens ofcurated samples for calibration, MagCache only requires a single sample forcalibration. Experimental results show that MagCache achieves 2.1x and 2.68xspeedups on Open-Sora and Wan 2.1, respectively, while preserving superiorvisual fidelity. It significantly outperforms existing methods in LPIPS, SSIM,and PSNR, under comparable computational budgets.

 

Quick Read (beta)

loading the full paper ...