Abstract
Current deep learning based segmentation models often generalize poorlybetween domains due to insufficient training data. In real-world clinicalapplications, cross-domain image analysis tools are in high demand sincemedical images from different domains are often needed to achieve a precisediagnosis. An important example in radiology is generalizing from non-contrastCT to contrast enhanced CTs. Contrast enhanced CT scans at different phases areused to enhance certain pathologies or organs. Many existing cross-domainimage-to-image translation models have been shown to improve cross-domainsegmentation of large organs. However, such models lack the ability to preservefine structures during the translation process, which is significant for manyclinical applications, such as segmenting small calcified plaques in the aortaand pelvic arteries. In order to preserve fine structures during medical imagetranslation, we propose a patch-based model using shared latent variables froma Gaussian mixture model. We compare our image translation framework to severalstate-of-the-art methods on cross-domain image translation and show our modeldoes a better job preserving fine structures. The superior performance of ourmodel is verified by performing two tasks with the translated images -detection and segmentation of aortic plaques and pancreas segmentation. Weexpect the utility of our framework will extend to other problems beyondsegmentation due to the improved quality of the generated images and enhancedability to preserve small structures.