Language-Enhanced Generative Modeling for PET Synthesis from MRI and Blood Biomarkers

  • 2025-11-04 02:53:25
  • Zhengjie Zhang, Xiaoxie Mao, Qihao Guo, Shaoting Zhang, Qi Huang, Mu Zhou, Fang Xie, Mianxin Liu
  • 0

Abstract

Background: Alzheimer's disease (AD) diagnosis heavily relies on amyloid-betapositron emission tomography (Abeta-PET), which is limited by high cost andlimited accessibility. This study explores whether Abeta-PET spatial patternscan be predicted from blood-based biomarkers (BBMs) and MRI scans. Methods: Wecollected Abeta-PET images, T1-weighted MRI scans, and BBMs from 566participants. A language-enhanced generative model, driven by a large languagemodel (LLM) and multimodal information fusion, was developed to synthesize PETimages. Synthesized images were evaluated for image quality, diagnosticconsistency, and clinical applicability within a fully automated diagnosticpipeline. Findings: The synthetic PET images closely resemble real PET scans inboth structural details (SSIM = 0.920 +/- 0.003) and regional patterns(Pearson's r = 0.955 +/- 0.007). Diagnostic outcomes using synthetic PET showhigh agreement with real PET-based diagnoses (accuracy = 0.80). Using syntheticPET, we developed a fully automatic AD diagnostic pipeline integrating PETsynthesis and classification. The synthetic PET-based model (AUC = 0.78)outperforms T1-based (AUC = 0.68) and BBM-based (AUC = 0.73) models, whilecombining synthetic PET and BBMs further improved performance (AUC = 0.79).Ablation analysis supports the advantages of LLM integration and promptengineering. Interpretation: Our language-enhanced generative model synthesizesrealistic PET images, enhancing the utility of MRI and BBMs for Abeta spatialpattern assessment and improving the diagnostic workflow for Alzheimer'sdisease.

 

Quick Read (beta)

loading the full paper ...