Generating synthetic CEM from low-energy images using deep learning: A future without contrast media? A proof-of-concept study.
Authors
Affiliations (8)
Affiliations (8)
- Fondazione Policlinico Universitario Agostino Gemelli IRCCS, Rome, Italy. [email protected].
- Università Cattolica del Sacro Cuore, Rome, Italy. [email protected].
- Computational Pathology and Spatially-Integrated Omics GSTeP Facility, Fondazione Policlinico Universitario Agostino Gemelli IRCCS, Rome, Italy. [email protected].
- The Institute of Cancer Research, London, UK.
- Royal Marsden Hospital, London, UK.
- Fondazione Policlinico Universitario Agostino Gemelli IRCCS, Rome, Italy.
- Department of Biomedical Imaging and Image-Guided Therapy, Medical University of Vienna, Vienna, Austria.
- Università Cattolica del Sacro Cuore, Rome, Italy.
Abstract
We used deep learning to generate synthetic, resembling in appearance, iodine-enhanced, mammograms from low-energy contrast-enhanced mammography (CEM) images. We retrospectively selected 140 CEM examinations. We trained a two-dimensional cycle-generative adversarial network on 390 images in 100 patients (195 breasts; 102 positive and 93 negative for lesion detection) using paired low-energy and iodine-enhanced images as input and output, respectively. We validated our model in 40 test patients (63 breasts; 37 positive and 26 negative for lesion detection) by calculating the contrast-to-noise ratio (CNR) for low-energy, synthetic, and clinical iodine-enhanced images and the mean absolute error (MAE) and similarity index metric (SSIM) between clinical and synthetic iodine-enhanced images regarding their changes from low-energy. Three radiologists scored (a-to-d) the test set images for background parenchymal enhancement (BPE) and lesion detection (yes/no) on clinical and synthetic images. The presence of artifacts was reported on all images. We observed a high correlation between clinical and synthetic iodine-enhanced images regarding their changes from low-energy: MAE, r = 0.99; SSIM, r = 0.80. CNR was -0.015/-0.16 ± 0.23/0.05 (mean ± standard deviation) for clinical/synthetic, respectively. A "halo" artifact present in above 50% of the clinical iodine-enhanced images was corrected in the synthetic ones. On synthetic images, BPE (scores a-b versus c-d) was 85.8% accurate. Lesion detection accuracy was 89.4% and 79.4%, sensitivity 87.4 and 72.1%, and specificity 92.3% and 90.0% for clinical and synthetic images, respectively. Deep learning holds the potential to generate synthetic iodine-enhanced mammograms from low-energy images. Radiologists could perform some clinical tasks, such as lesion detection and BPE estimation on synthetic iodine-enhanced images, without contrast injection. Our deep learning model generated synthetic iodine-enhanced images that visually resembled the clinical iodine-enhanced images. Radiologists could use the synthetic images to perform clinical tasks, such as lesion detection and BPE evaluation. Our model can improve image quality by removing common artifacts, including the breast-in-breast (halo). Our method is a way to combine the benefits of CEM while sparing the need for contrast media.