An Efficient 3D Latent Diffusion Model for T1-contrast Enhanced MRI Generation.
Authors
Affiliations (9)
Affiliations (9)
- Emory University School of Medicine, 1365-C Clifton Road NE, Atlanta, 30322, UNITED STATES.
- Department of Radiation Oncology and Winship Cancer Institute, Emory University, 1365 Clifton Rd NE Building C, Atlanta, Georgia, 30322, UNITED STATES.
- Emory University, 1365-C Clifton Road NE, Atlanta, Georgia, 30322, UNITED STATES.
- Department of Radiology and Sciences Imaging Department of Radiology Oncology, Emory University, 1365-C Clifton Road NE, Atlanta, Georgia, 30322, UNITED STATES.
- Department of Radiology and Sciences Imaging Department of Radiology Oncology, Emory University, 30322, Atlanta, Georgia, 30322, UNITED STATES.
- Radiation Oncology, Emory University School of Medicine, 1365 Clifton Rd NE Building C, Atlanta, Georgia, 30303-3073, UNITED STATES.
- Radiation & Cellular Oncology, The University of Chicago, 5758 S Maryland Ave, Chicago, Illinois, 60637-1476, UNITED STATES.
- Department of Radiology and Fredrick Philips MR Research Center, Emory University, 1364 Clifton Road, Atlanta, Georgia 30322, USA, Atlanta, 30322, UNITED STATES.
- Department of Radiology Oncology, Emory University, Clifton Rd, Atlanta, Georgia, 30322-1007, UNITED STATES.
Abstract
Gadolinium-based contrast agents (GBCAs) are commonly employed with T1-weighted (T1w) MRI to enhance lesion visualization but are restricted in patients at risk of nephrogenic systemic fibrosis and variations in GBCA administration can introduce imaging inconsistencies. This study develops an efficient 3D deep-learning framework to generate T1-contrast enhanced images (T1C) from pre-contrast multiparametric MRI.
Approach: We propose the 3D latent rectified flow (T1C-RFlow) model for generating high-quality T1C images. First, T1w and T2-FLAIR images are input into a pretrained autoencoder to acquire an efficient latent space representation. A rectified flow diffusion model is then trained in this latent space representation. The T1C-RFlow model was trained on a curated dataset comprised of the Brain Tumor Segmentation (BraTS) 2024 glioma (GLI; 1480 patients), meningioma (MEN; 1141 patients), and metastases (MET; 1475 patients) datasets. Selected patients were split into training (N=2860), validation (N=612), and test (N=614) sets. Model performance was evaluated with the normalized mean squared error (NMSE) and structural similarity index measure (SSIM).
Results: Both qualitative and quantitative results demonstrate that the T1C-RFlow model outperforms benchmark 3D models (pix2pix, denoising diffusion probability models (DDPM), Diffusion Transformers (DiT-3D)) trained in the same latent space. T1C-RFlow achieved the following metrics - GLI: NMSE 0.044 ± 0.047, SSIM 0.935 ± 0.025; MEN: NMSE 0.046 ± 0.029, SSIM 0.937 ± 0.021; MET: NMSE 0.098 ± 0.088, SSIM 0.905 ± 0.082. Further studies showed T1C-RFlow to have the best tumor reconstruction performance and significantly faster denoising times (6.9 s/volume, 200 steps) than conventional DDPM models in both latent space (37.7s, 1000 steps) and patch-based in image space (4.3 hr/volume).
Significance: Our proposed method generates synthetic T1C images that closely resemble radiological features of ground truth T1C in much less time than previous diffusion models. Further development may permit a practical method for contrast-agent-free MRI for brain tumors.
.