Abstract
With an aim to increase the capture range and accelerate the performance ofstate-of-the-art inter-subject and subject-to-template 3D registration, wepropose deep learning-based methods that are trained to find the 3D position ofarbitrarily oriented subjects or anatomy based on slices or volumes of medicalimages. For this, we propose regression CNNs that learn to predict theangle-axis representation of 3D rotations and translations using imagefeatures. We use and compare mean square error and geodesic loss for trainingregression CNNs in two different scenarios: 3D pose estimation from slices and3D to 3D registration. As an exemplary application, we applied the proposedmethods to register arbitrarily oriented reconstructed images of fetusesscanned in-utero at a wide gestational age range to a standard atlas space. Ourresults show that in such registration applications that are amendable tolearning, the proposed deep learning methods with geodesic loss minimizationcan achieve accurate results with a wide capture range in real-time (<100ms).We tested the generalization capability of the trained CNNs on an expanded agerange and on images of newborn subjects with similar and different MR imagecontrasts. We trained our models on T2-weighted fetal brain MRI scans and usedthem to predict the 3D position of newborn brains based on T1-weighted MRIscans. We showed that trained models generalized well for the new domain whenwe performed image contrast transfer through a conditional generativeadversarial network. This indicates that the domain of application of thetrained deep regression CNNs can be further expanded to image modalities andcontrasts other than those used in training. A combination of our proposedmethods with optimization-based registration algorithms can dramaticallyenhance the performance of automatic imaging devices and image processingmethods of the future.