Multi-task learning for joint prediction of breast cancer histological indicators in dynamic contrast-enhanced magnetic resonance imaging.
Authors
Affiliations (4)
Affiliations (4)
- School of Health Science and Engineering, University of Shanghai for Science and Technology, Shanghai, China.
- Medical Imaging Center, the affiliated Tai'an City Central Hospital of Qingdao University, Shandong, China.
- Department of General Surgery, Xinhua Hospital, affiliated with Shanghai Jiao Tong University School of Medicine, Shanghai, China.
- School of Health Science and Engineering, University of Shanghai for Science and Technology, Shanghai, China. Electronic address: [email protected].
Abstract
Achieving efficient analysis of multiple pathological indicators has great significance for breast cancer prognosis and therapeutic decision-making. In this study, we aim to explore a deep multi-task learning (MTL) framework for collaborative prediction of histological grade and proliferation marker (Ki-67) status in breast cancer using multi-phase dynamic contrast-enhanced magnetic resonance imaging (DCE-MRI). In the novel design of hybrid multi-task architecture (HMT-Net), co-representative features are explicitly distilled using a feature extraction backbone. A customized prediction network is then introduced to perform soft-parameter sharing between two correlated tasks. Specifically, task-common and task-specific knowledge is transmitted into tower layers for informative interactions. Furthermore, low-level feature maps containing tumor edges and texture details are recaptured by a hard-parameter sharing branch, which are then incorporated into the tower layer for each subtask. Finally, the probabilities of two histological indicators, predicted in the multi-phase DCE-MRI, are separately fused using a decision-level fusion strategy. Experimental results demonstrate that the proposed HMT-Net achieves optimal discriminative performance over other recent MTL architectures and deep models based on single image series, with the area under the receiver operating characteristic curve of 0.908 for tumor grade and 0.694 for Ki-67 status. Benefiting from the innovative HMT-Net, our proposed method elucidates its strong robustness and flexibility in the collaborative prediction task of breast biomarkers. Multi-phase DCE-MRI is expected to contribute valuable dynamic information for breast cancer pathological assessment in a non-invasive manner.