Abstract
The success and generalisation of deep learning algorithms heavily depend onlearning good feature representations. In medical imaging this entailsrepresenting anatomical information, as well as properties related to thespecific imaging setting. Anatomical information is required to perform furtheranalysis, whereas imaging information is key to disentangle scanner variabilityand potential artefacts. The ability to factorise these would allow fortraining algorithms only on the relevant information according to the task. Todate, such factorisation has not been attempted. In this paper, we propose amethodology of latent space factorisation relying on the cycle-consistencyprinciple. As an example application, we consider cardiac MR segmentation,where we separate information related to the myocardium from other featuresrelated to imaging and surrounding substructures. We demonstrate the proposedmethod's utility in a semi-supervised setting: we use very few labelled imagestogether with many unlabelled images to train a myocardium segmentation neuralnetwork. Compared to fully supervised networks we achieve comparableperformance using a fraction of labelled images in experiments on ACDC and aprivate data set.