LLM-Enhanced Multimodal Fusion of SPECT Radiomics and Clinical Data for Predicting 131I Therapeutic Response in Differentiated Thyroid Cancer.
Authors
Affiliations (17)
Affiliations (17)
- School of Biomedical Engineering, Southern Medical University, 1023 Shatai Road, Guangzhou, 510515, China.
- School of Biomedical Engineering and Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, 1023 Shatai Road, Guangzhou, 510515, China.
- Guangdong Province Engineering Laboratory for Medical Imaging and Diagnostic Technology, Southern Medical University, 1023 Shatai Road, Guangzhou, 510515, China.
- Zhujiang Hospital, Southern Medical University, Guangzhou, 510220, China.
- Shenzhen People's Hospital, Luohu District, 1017 Dongmen North Road, Shenzhen, 518020, No.Guangdong , China.
- State Key Laboratory of Oncology in South China, Guangdong Key Laboratory of Nasopharyngeal Carcinoma Diagnosis and Therapy, Guangdong Provincial Clinical Research Center for Cancer, Sun Yat-Sen University Cancer Center, Guangzhou, 510060, People's Republic of China. [email protected].
- Department of Radiation Oncology, Sun Yat-Sen University Cancer Center, Guangzhou, China. [email protected].
- School of Biomedical Engineering, Southern Medical University, 1023 Shatai Road, Guangzhou, 510515, China. [email protected].
- School of Biomedical Engineering and Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, 1023 Shatai Road, Guangzhou, 510515, China. [email protected].
- Guangdong Province Engineering Laboratory for Medical Imaging and Diagnostic Technology, Southern Medical University, 1023 Shatai Road, Guangzhou, 510515, China. [email protected].
- State Key Laboratory of Oncology in South China, Guangdong Key Laboratory of Nasopharyngeal Carcinoma Diagnosis and Therapy, Guangdong Provincial Clinical Research Center for Cancer, Sun Yat-Sen University Cancer Center, Guangzhou, 510060, People's Republic of China. [email protected].
- Department of Radiation Oncology, Sun Yat-Sen University Cancer Center, Guangzhou, China. [email protected].
- School of Biomedical Engineering, Southern Medical University, 1023 Shatai Road, Guangzhou, 510515, China. [email protected].
- School of Biomedical Engineering and Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, 1023 Shatai Road, Guangzhou, 510515, China. [email protected].
- Guangdong Province Engineering Laboratory for Medical Imaging and Diagnostic Technology, Southern Medical University, 1023 Shatai Road, Guangzhou, 510515, China. [email protected].
- Zhujiang Hospital, Southern Medical University, Guangzhou, 510220, China. [email protected].
- Department of Nuclear Medicine, Zhujiang Hospital of Southern Medical University, Guangzhou, China. [email protected].
Abstract
Patients with differentiated thyroid cancer (DTC) treated with radioactive iodine (RAI) remain at risk of adverse outcomes. Early prediction of RAI efficacy is critical for optimizing clinical management. To develop a model integrating Single Photon Emission Computed Tomography (SPECT) radiomic features and clinical variables for predicting the therapeutic efficacy of 131I treatment in patients with DTC. The SPECT images and clinical data from 311 patients were included in this study. A total of 1,688 radiomic features were extracted from SPECT images. We investigated the diagnostic performance of 30 cross-combined models. Radiomic features were then combined with clinical parameters using early-fusion and late-fusion strategies. To further enhance predictive performance, an input sequence reflecting the selected features and the prediction task was designed and fed into a selected Large Language Model (LLM), which was fine-tuned using low-rank adaptation to optimize fused feature representations. Model performance was evaluated using accuracy (Acc), sensitivity (Sens), positive predictive value (PPV), F1-score, and the area under the curve (AUC). The Relief-F + random forest radiomic model achieved the highest AUC (0.69). Multimodal models combining radiomics with clinical features outperformed clinical-only models, demonstrating the added predictive value of radiomics. The final LLM-enhanced multimodal model achieved the best performance, with an AUC of 0.85 and notable improvements in sensitivity and F1-score. The proposed multimodal framework provides accurate early prediction of RAI therapeutic response in DTC and holds promise for improving individualized treatment planning and follow-up strategies.