Abstract
Denoising diffusion probabilistic models (DDPMs) have achieved unprecedentedsuccess in computer vision. However, they remain underutilized in medicalimaging, a field crucial for disease diagnosis and treatment planning. This isprimarily due to the high computational cost associated with (1) the use oflarge number of time steps (e.g., 1,000) in diffusion processes and (2) theincreased dimensionality of medical images, which are often 3D or 4D. Traininga diffusion model on medical images typically takes days to weeks, whilesampling each image volume takes minutes to hours. To address this challenge,we introduce Fast-DDPM, a simple yet effective approach capable of improvingtraining speed, sampling speed, and generation quality simultaneously. UnlikeDDPM, which trains the image denoiser across 1,000 time steps, Fast-DDPM trainsand samples using only 10 time steps. The key to our method lies in aligningthe training and sampling procedures to optimize time-step utilization.Specifically, we introduced two efficient noise schedulers with 10 time steps:one with uniform time step sampling and another with non-uniform sampling. Weevaluated Fast-DDPM across three medical image-to-image generation tasks:multi-image super-resolution, image denoising, and image-to-image translation.Fast-DDPM outperformed DDPM and current state-of-the-art methods based onconvolutional networks and generative adversarial networks in all tasks.Additionally, Fast-DDPM reduced the training time to 0.2x and the sampling timeto 0.01x compared to DDPM. Our code is publicly available at:https://github.com/mirthAI/Fast-DDPM.