Abstract
Discriminative classifiers have become a foundational tool in deep learningfor medical imaging, excelling at learning separable features of complex datadistributions. However, these models often need careful design, augmentation,and training techniques to ensure safe and reliable deployment. Recently,diffusion models have become synonymous with generative modeling in 2D. Thesemodels showcase robustness across a range of tasks including natural imageclassification, where classification is performed by comparing reconstructionerrors across images generated for each possible conditioning input. This workpresents the first exploration of the potential of class conditional diffusionmodels for 2D medical image classification. First, we develop a novel majorityvoting scheme shown to improve the performance of medical diffusionclassifiers. Next, extensive experiments on the CheXpert and ISIC Melanoma skincancer datasets demonstrate that foundation and trained-from-scratch diffusionmodels achieve competitive performance against SOTA discriminative classifierswithout the need for explicit supervision. In addition, we show that diffusionclassifiers are intrinsically explainable, and can be used to quantify theuncertainty of their predictions, increasing their trustworthiness andreliability in safety-critical, clinical contexts. Further information isavailable on our project page:https://faverogian.github.io/med-diffusion-classifier.github.io/.