PIMMS: Permutation Invariant Multi-Modal Segmentation

  • 2018-07-17 16:32:38
  • Thomas Varsavsky, Zach Eaton-Rosen, Carole H. Sudre, Parashkev Nachev, M. Jorge Cardoso
  • 4

Abstract

In a research context, image acquisition will often involve a pre-definedstatic protocol and the data will be of high quality. If we are to buildapplications that work in hospitals without significant operational changes incare delivery, algorithms should be designed to cope with the available data inthe best possible way. In a clinical environment, imaging protocols are highlyflexible, with MRI sequences commonly missing appropriate sequence labeling(e.g. T1, T2, FLAIR). To this end we introduce PIMMS, a Permutation InvariantMulti-Modal Segmentation technique that is able to perform inference over setsof MRI scans without using modality labels. We present results which show thatour convolutional neural network can, in some settings, outperform a baselinemodel which utilizes modality labels, and achieve comparable performanceotherwise.

 

Quick Read (beta)

loading the full paper ...