Structure-aware multi-task learning with domain generalization for robust vertebrae analysis in spinal CT.
Authors
Affiliations (14)
Affiliations (14)
- Cancer Center, Department of Neurosurgery, Zhejiang Provincial People's Hospital, Affiliated People's Hospital, Hangzhou Medical College, Hangzhou, Zhejiang, China.
- Department of Neurosurgery, Shandong Provincial Hospital Affiliated to Shandong First Medical University, Jinan, Shandong, China.
- College of Optical and Engineering, Zhejiang University, Hangzhou, Zhejiang, China.
- Department of Sports Medicine, Tongji Hospital, School of Medicine, Tongji University, Shanghai, China.
- Department of Orthopedic, Fuzhou University Affiliated Provincial Hospital, Fuzhou, Fujian, China.
- School of Software & Microelectronics, Peking University, Beijing, China.
- Department of Oral Surgery, Shanghai Ninth People's Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China.
- Shanghai Key Laboratory of Orthopedic Implants, Shanghai Ninth People's Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China.
- School of Environment, Education and Development, The University of Manchester, Manchester, UK.
- School of Medicine, Tongji University, Shanghai, China.
- Department of Radiology, Suzhou Kowloon Hospital, Shanghai Jiaotong University School of Medicine, Suzhou, Jiangsu, China.
- Department of Neurosurgery, Shandong Provincial Hospital Affiliated to Shandong First Medical University, Jinan, Shandong, China. [email protected].
- Cancer Center, Department of Neurosurgery, Zhejiang Provincial People's Hospital, Affiliated People's Hospital, Hangzhou Medical College, Hangzhou, Zhejiang, China. [email protected].
- Department of Sports Medicine, Tongji Hospital, School of Medicine, Tongji University, Shanghai, China. [email protected].
Abstract
Spinal image analysis plays a critical role in the diagnosis and treatment of musculoskeletal and neurological disorders. However, existing vertebrae segmentation methods suffer from limited generalizability across clinical domains and rarely address downstream tasks such as vertebrae identification and lesion localization. In this work, we introduce VertebraFormer, a unified multi-task framework designed for robust and generalizable spinal CT analysis. To support this framework, we curate MultiSpine, a heterogeneous benchmark comprising CT volumes from four public and private datasets, annotated with vertebra segmentation masks, anatomical labels, and pathology regions. Our method integrates a Transformer encoder with task-specific decoders and a dynamic modulation unit that adapts feature representations to different imaging domains. We evaluate VertebraFormer across three key tasks-vertebra segmentation, vertebra numbering, and lesion localization, under both in-domain and cross-domain settings. Extensive experiments demonstrate that VertebraFormer outperforms competitive baselines in both accuracy and robustness. We further conduct ablation, perturbation, and efficiency analyses to validate the framework.