Abstract
AI models have shown promise in many medical imaging tasks. However, ourability to explain what signals these models have learned is severely lacking.Explanations are needed in order to increase the trust in AI-based models, andcould enable novel scientific discovery by uncovering signals in the data thatare not yet known to experts. In this paper, we present a method for automaticvisual explanations leveraging team-based expertise by generating hypotheses ofwhat visual signals in the images are correlated with the task. We propose thefollowing 4 steps: (i) Train a classifier to perform a given task (ii) Train aclassifier guided StyleGAN-based image generator (StylEx) (iii) Automaticallydetect and visualize the top visual attributes that the classifier is sensitivetowards (iv) Formulate hypotheses for the underlying mechanisms, to stimulatefuture research. Specifically, we present the discovered attributes to aninterdisciplinary panel of experts so that hypotheses can account for socialand structural determinants of health. We demonstrate results on eightprediction tasks across three medical imaging modalities: retinal fundusphotographs, external eye photographs, and chest radiographs. We showcaseexamples of attributes that capture clinically known features, confounders thatarise from factors beyond physiological mechanisms, and reveal a number ofphysiologically plausible novel attributes. Our approach has the potential toenable researchers to better understand, improve their assessment, and extractnew knowledge from AI-based models. Importantly, we highlight that attributesgenerated by our framework can capture phenomena beyond physiology orpathophysiology, reflecting the real world nature of healthcare delivery andsocio-cultural factors. Finally, we intend to release code to enableresearchers to train their own StylEx models and analyze their predictivetasks.