Neuromorphologicaly-preserving Volumetric data encoding using VQ-VAE

  • 2020-02-13 18:18:51
  • Petru-Daniel Tudosiu, Thomas Varsavsky, Richard Shaw, Mark Graham, Parashkev Nachev, Sebastien Ourselin, Carole H. Sudre, M. Jorge Cardoso
  • 3


The increasing efficiency and compactness of deep learning architectures,together with hardware improvements, have enabled the complex andhigh-dimensional modelling of medical volumetric data at higher resolutions.Recently, Vector-Quantised Variational Autoencoders (VQ-VAE) have been proposedas an efficient generative unsupervised learning approach that can encodeimages to a small percentage of their initial size, while preserving theirdecoded fidelity. Here, we show a VQ-VAE inspired network can efficientlyencode a full-resolution 3D brain volume, compressing the data to $0.825\%$ ofthe original size while maintaining image fidelity, and significantlyoutperforming the previous state-of-the-art. We then demonstrate that VQ-VAEdecoded images preserve the morphological characteristics of the original datathrough voxel-based morphology and segmentation experiments. Lastly, we showthat such models can be pre-trained and then fine-tuned on different datasetswithout the introduction of bias.


Quick Read (beta)

loading the full paper ...