Noninvasive molecular subtyping of breast cancer using multimodal ultrasound spatiotemporal transformer.
Authors
Affiliations (13)
Affiliations (13)
- Institute of Science and Technology for Brain-Inspired Intelligence, Fudan University, Shanghai, China.
- MOE Frontiers Center for Brain Science, Fudan University, Shanghai, China.
- MOE Key Laboratory of Computational Neuroscience and Brain-Inspired Intelligence, Fudan University, Shanghai, China.
- Department of Ultrasound, Shanghai Chest Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China.
- Department of Ultrasound, Shanghai General Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China.
- School of Health Science and Engineering, University of Shanghai for Science and Technology, Shanghai, China.
- Department of Ultrasound, Shidong Hospital, Shanghai, China.
- Department of Ultrasound, Qingdao Hospital, University of Health and Rehabilitation Sciences (Qingdao Municipal Hospital), Qingdao, China.
- Department of Ultrasound, Shanxi Province Cancer Hospital/ Shanxi Hospital Affiliated to Cancer Hospital, Chinese Academy of Medical Sciences/Cancer Hospital Affiliated to Shanxi Medical University, Taiyuan, China.
- Department of Ultrasound, Shanghai Chest Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China. [email protected].
- Institute of Science and Technology for Brain-Inspired Intelligence, Fudan University, Shanghai, China. [email protected].
- MOE Frontiers Center for Brain Science, Fudan University, Shanghai, China. [email protected].
- MOE Key Laboratory of Computational Neuroscience and Brain-Inspired Intelligence, Fudan University, Shanghai, China. [email protected].
Abstract
Molecular subtyping is essential for guiding systemic therapy in breast cancer but currently requires invasive biopsy. Conventional B-mode ultrasound offers rich anatomical information, yet lacks the functional dynamics needed to capture the comprehensive biology of tumors. Here, we present the first multimodal ultrasound spatiotemporal transformer, MUST-Sub, which integrates paired B-mode morphological features with contrast-enhanced ultrasound (CEUS) hemodynamic patterns to classify Luminal, HER2-enriched, and triple-negative subtypes. Training on a retrospective development cohort, and validated on internal, prospective, and multicenter external cohorts, MUST-Sub achieved macro-average areas under the receiver operating characteristic curve (AUCs) of 0.94, 0.90, and 0.92, respectively, and Luminal versus non-Luminal AUCs of 0.92, 0.88, and 0.91, outperforming B-mode-only deep learning baselines. MUST-Sub also produced interpretable quantitative biomarkers derived from spatiotemporal attention: the morphology-associated biomarker showed inverse correlations with tumor size (Spearman ρ = [- 0.34, - 0.23]; all p < . 05), while the hemodynamics-associated biomarker correlated positively with tumor size (ρ = [0.24, 0.32]; all p < . 05) and Ki-67 proliferation index (ρ = [0.21, 0.24]; all p < . 05). These results suggest that multimodal ultrasound with spatiotemporal modeling can serve as a promising adjunctive approach for non-invasive pre-biopsy molecular phenotyping of breast cancer.