Malignancy prediction for calcified thyroid nodules using deep learning based on ultrasound dynamic videos.
Authors
Affiliations (18)
Affiliations (18)
- Department of Diagnostic Ultrasound Imaging & Interventional Therapy, Hangzhou Institute of Medicine (HIM), Zhejiang Cancer Hospital, Chinese Academy of Sciences, Hangzhou, 310022, China.
- Graduate School, The Second Clinical Medical College of Zhejiang Chinese Medical University, Hangzhou, 310014, China.
- Research Center of Interventional Medicine and Engineering, Hangzhou Institute of Medicine (HIM), Chinese Academy of Sciences, Hangzhou, Zhejiang, 310000, China.
- Center of Intelligent Diagnosis and Therapy (Taizhou), Hangzhou Institute of Medicine (HIM), Chinese Academy of Sciences, Taizhou, Zhejiang, 317502, China.
- Taizhou Key Laboratory of Minimally Invasive Interventional Therapy & Artificial Intelligence, Taizhou Branch of Zhejiang Cancer Hospital (Taizhou Cancer Hospital), Taizhou, Zhejiang, 317502, China.
- Wenling Institute of Big Data and Artificial Intelligence in Medicine, Taizhou, Zhejiang, 317502, China.
- Department of Ultrasound, Hangzhou Traditional Chinese Medicine Hospital, Hangzhou, 310000, China.
- Postgraduate Training Base Alliance of Wenzhou Medical University, Hangzhou, Zhejiang, 325035, China.
- XianJu People's Hospital, Zhejiang Southeast Campus of Zhejiang Provincial People's Hospital, Affiliated Xianju's Hospital, Hangzhou Medical College, Xianju, Zhejiang, China.
- Tongxiang First People's Hospital, Jiao Chang Road 1918, Tongxiang, Zhejiang, 314500, China.
- Department of Diagnostic Ultrasound Imaging & Interventional Therapy, Hangzhou Institute of Medicine (HIM), Zhejiang Cancer Hospital, Chinese Academy of Sciences, Hangzhou, 310022, China. [email protected].
- Research Center of Interventional Medicine and Engineering, Hangzhou Institute of Medicine (HIM), Chinese Academy of Sciences, Hangzhou, Zhejiang, 310000, China. [email protected].
- Center of Intelligent Diagnosis and Therapy (Taizhou), Hangzhou Institute of Medicine (HIM), Chinese Academy of Sciences, Taizhou, Zhejiang, 317502, China. [email protected].
- Wenling Institute of Big Data and Artificial Intelligence in Medicine, Taizhou, Zhejiang, 317502, China. [email protected].
- Department of Diagnostic Ultrasound Imaging & Interventional Therapy, Hangzhou Institute of Medicine (HIM), Zhejiang Cancer Hospital, Chinese Academy of Sciences, Hangzhou, 310022, China. [email protected].
- Research Center of Interventional Medicine and Engineering, Hangzhou Institute of Medicine (HIM), Chinese Academy of Sciences, Hangzhou, Zhejiang, 310000, China. [email protected].
- Wenling Institute of Big Data and Artificial Intelligence in Medicine, Taizhou, Zhejiang, 317502, China. [email protected].
- Wenzhou Medical University, Wenzhou, Zhejiang, 325035, China. [email protected].
Abstract
The presence of calcification, especially microcalcification, is often associated with an increased risk of malignancy and closely linked to papillary thyroid carcinoma (PTC), the most common type of thyroid cancer. However, existing diagnostic ultrasound (US) imaging has critical limitations such as inability to detect subtle calcifications via standard static imaging, leading to 15-20% delayed PTC treatment or unnecessary fine-needle aspiration. This study aimed to develop a calcification-optimized, interpretable deep learning (DL) model based on dynamic ultrasound videos to determine the malignancy nature of calcified thyroid nodules. This study retrospectively collected ultrasound dynamic video data from 1,257 patients, containing 2,319 thyroid nodules across six hospitals between January 2020 and October 2023. Various DL models were constructed with optimization specifically implemented on the 3D InceptionResNetV2 network by including a calcification attention module to enhance sensitivity to micro-calcifications. Model performance was compared not only with those trained on 2D static ultrasound images, but also against diagnoses from four clinicians (2 junior and 2 senior radiologists). The dataset was split into training (70%, 1,623 videos), validation (10%, 232 videos), internal test (10%, 232 videos), and external test (10%, 232 videos) sets. On the external test set, the optimized 3D InceptionResNetV2 model trained with dynamic videos outperformed the other four 3D DL models across all metrics: AUROC of 0.916, sensitivity of 0.860, and specificity of 0.834. Its AUROC was significantly higher than that of radiologists (0.916 versus 0.638; p < 0.0001). Additionally, with the assistance of the optimized model, radiologists' diagnostic accuracy improved by 16.9% (junior) and 11.1% (senior) in the external cohort. 3D Grad-CAM further confirmed the model focused on calcified regions (consistent with clinical diagnostic logic) by generating interpretable heatmaps. A calcification-optimized DL model trained on dynamic ultrasound videos was proposed to efficiently and accurately predict the benign/malignant nature of calcified nodules. This tool shows promises as a non-invasive, interpretable tool for early PTC detection, supporting timely diagnosis and treatment planning.