Abstract
3D image segmentation plays an important role in biomedical image analysis.Many 2D and 3D deep learning models have achieved state-of-the-art segmentationperformance on 3D biomedical image datasets. Yet, 2D and 3D models have theirown strengths and weaknesses, and by unifying them together, one may be able toachieve more accurate results. In this paper, we propose a new ensemblelearning framework for 3D biomedical image segmentation that combines themerits of 2D and 3D models. First, we develop a fully convolutional networkbased meta-learner to learn how to improve the results from 2D and 3D models(base-learners). Then, to minimize over-fitting for our sophisticatedmeta-learner, we devise a new training method that uses the results of thebase-learners as multiple versions of "ground truths". Furthermore, since ournew meta-learner training scheme does not depend on manual annotation, it canutilize abundant unlabeled 3D image data to further improve the model.Extensive experiments on two public datasets (the HVSMR 2016 Challenge datasetand the mouse piriform cortex dataset) show that our approach is effectiveunder fully-supervised, semi-supervised, and transductive settings, and attainssuperior performance over state-of-the-art image segmentation methods.