Abstract
Multi-sequence Magnetic Resonance Imaging (MRI) offers remarkableversatility, enabling the distinct visualization of different tissue types.Nevertheless, the inherent heterogeneity among MRI sequences poses significantchallenges to the generalization capability of deep learning models. Thesechallenges undermine model performance when faced with varying acquisitionparameters, thereby severely restricting their clinical utility. In this study,we present PRISM, a foundation model PRe-trained with large-scalemultI-Sequence MRI. We collected a total of 64 datasets from both public andprivate sources, encompassing a wide range of whole-body anatomical structures,with scans spanning diverse MRI sequences. Among them, 336,476 volumetric MRIscans from 34 datasets (8 public and 26 private) were curated to construct thelargest multi-organ multi-sequence MRI pretraining corpus to date. We propose anovel pretraining paradigm that disentangles anatomically invariant featuresfrom sequence-specific variations in MRI, while preserving high-level semanticrepresentations. We established a benchmark comprising 44 downstream tasks,including disease diagnosis, image segmentation, registration, progressionprediction, and report generation. These tasks were evaluated on 32 publicdatasets and 5 private cohorts. PRISM consistently outperformed bothnon-pretrained models and existing foundation models, achieving first-rankresults in 39 out of 44 downstream benchmarks with statistical significanceimprovements. These results underscore its ability to learn robust andgeneralizable representations across unseen data acquired under diverse MRIprotocols. PRISM provides a scalable framework for multi-sequence MRI analysis,thereby enhancing the translational potential of AI in radiology. It deliversconsistent performance across diverse imaging protocols, reinforcing itsclinical applicability.