Comparative Clinical Evaluation of "Memory-Efficient" Synthetic 3D Generative Adversarial Networks (GAN) Head-to-Head to State of Art: Results on Computed Tomography of the Chest.
Authors
Affiliations (5)
Affiliations (5)
- Dipartimento Di Elettronica, Informazione E Bioingegneria, Politecnico Di Milano, Milan, Italy.
- Radiology Institute, Fondazione IRCCS Policlinico San Matteo Pavia - Università Degli Studi Di Pavia, Pavia, Italy.
- Department of Business Law Economics, Faculty of Communication, Consumer Behavior "Carlo A. Ricciardi', IULM University, Milan, Italy.
- Radiology Institute, Fondazione IRCCS Policlinico San Matteo Pavia, Pavia, Italy.
- Radiology Institute, Fondazione IRCCS Policlinico San Matteo Pavia, Pavia, Italy. [email protected].
Abstract
Generative adversarial networks (GANs) are increasingly used to generate synthetic medical images, addressing the critical shortage of annotated data for training artificial intelligence (AI) systems. This study introduces conditional random field (CRF)-GAN, a novel memory-efficient GAN architecture that enhances structural consistency in 3D medical image synthesis. Integrating conditional random fields (CRFs) within a two-step generation process, allows CRF-GAN improving spatial coherence while maintaining high-resolution image quality. The model is designed to be computationally efficient, avoiding the need for additional GANs or post-processing. Its performance is evaluated against the state-of-the-art hierarchical (HA)-GAN model. We evaluate the performance of CRF-GAN against the state-of-the-art hierarchical (HA)-GAN model. The comparison between the two models was made through a quantitative evaluation, using Fréchet Inception distance (FID) and maximum mean discrepancy (MMD) metrics, and a qualitative evaluation, through a two-alternative forced choice (2AFC) test completed by a pool of 12 resident radiologists, in order to assess the realism of the generated images. CRF-GAN outperformed HA-GAN with lower FID (0.047 vs. 0.061) and MMD (0.084 vs. 0.086) scores, indicating better image fidelity. The 2AFC test showed a significant preference for images generated by CRF-Gan over those generated by HA-GAN with a p-value of 1.93e - 05. Additionally, CRF-GAN demonstrated 9.34% lower memory usage at 256<sup>3</sup> resolution and achieved up to 14.6% faster training speeds, offering substantial computational savings. CRF-GAN model successfully generates high-resolution 3D medical images with non-inferior quality to conventional models, while being more memory-efficient and faster. The key objective was not only to lower the computational cost but also to reallocate the freed-up resources towards the creation of higher-resolution 3D imaging, which is still a critical factor limiting their direct clinical applicability. Moreover, unlike many previous studies, we combined qualitative and quantitative assessments to obtain a more holistic feedback of model's performance.