Abstract
Flow-based 3D generation models typically require dozens of sampling stepsduring inference. Though few-step distillation methods, particularlyConsistency Models (CMs), have achieved substantial advancements inaccelerating 2D diffusion models, they remain under-explored for more complex3D generation tasks. In this study, we propose a novel framework, MDT-dist, forfew-step 3D flow distillation. Our approach is built upon a primary objective:distilling the pretrained model to learn the Marginal-Data Transport. Directlylearning this objective needs to integrate the velocity fields, while thisintegral is intractable to be implemented. Therefore, we propose twooptimizable objectives, Velocity Matching (VM) and Velocity Distillation (VD),to equivalently convert the optimization target from the transport level to thevelocity and the distribution level respectively. Velocity Matching (VM) learnsto stably match the velocity fields between the student and the teacher, butinevitably provides biased gradient estimates. Velocity Distillation (VD)further enhances the optimization process by leveraging the learned velocityfields to perform probability density distillation. When evaluated on thepioneer 3D generation framework TRELLIS, our method reduces sampling steps ofeach flow transformer from 25 to 1 or 2, achieving 0.68s (1 step x 2) and 0.94s(2 steps x 2) latency with 9.0x and 6.5x speedup on A800, while preserving highvisual and geometric fidelity. Extensive experiments demonstrate that ourmethod significantly outperforms existing CM distillation methods, and enablesTRELLIS to achieve superior performance in few-step 3D generation.