Generalizable medical image enhancement using structure-preserved diffusion models.
Authors
Affiliations (5)
Affiliations (5)
- Department of Ophthalmology, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences, 100730, Beijing, China, Beijing, Beijing, 100730, CHINA.
- the Department of Computer Science and Technology, Southern University of Science and Technology, No. 1088 Xueyuan Avenue, Xili University Town, Nanshan, Shenzhen, Guangdong, 518055, CHINA.
- Research Institute of Trustworthy Adaptive Systems, Southern University of Science and Technology, 1088 Xueyuan Avenue, Shenzhen 518055, P.R. China, Shenzhen, Guangdong, 518055, CHINA.
- Southern University of Science and Technology, No. 1088 Xueyuan Avenue, Xili University Town, Nanshan, Shenzhen, Guangdong, 518055, CHINA.
- Beijing Information Science and Technology University, No. 55 Taihang Road, Changping District, Beijing, China, Beijing, 100192, CHINA.
Abstract
Clinical medical images often suffer from compromised quality, which negatively impacts the diagnostic process by both clinicians and AI algorithms. While GAN-based enhancement methods have been commonly developed in recent years, delicate model training is necessary due to issues with artifacts, mode collapse, and instability. Diffusion models have shown promise in generating high-quality images superior to GANs, but challenges in training data collection and domain gaps hinder applying them for medical image enhancement. Additionally, preserving fine structures in enhancing medical images with diffusion models is still an area that requires further exploration. To overcome these challenges, we propose structure-preserved diffusion models for generalizable medical image enhancement (GEDM). GEDM leverages joint supervision from enhancement and segmentation to boost structure preservation and generalizability. Specifically, synthetic data is used to collect high-low quality paired training data with structure masks, and the Laplace transform is employed to reduce domain gaps and introduce multi-scale conditions. GEDM conducts medical image enhancement and segmentation jointly, supervised by high-quality references and structure masks from the training data. Four datasets of two medical imaging modalities were collected to implement the experiments, where GEDM outperformed state-of-the-art methods in image enhancement, as well as follow-up medical analysis tasks.