Multi-task and multi-scale attention network for lymph node metastasis prediction in esophageal cancer.
Authors
Affiliations (7)
Affiliations (7)
- Department of Radiation Oncology, Shandong Cancer Hospital and Institute, Shandong First Medical University and Shandong Academy of Medical Sciences, Jinan, Shandong, China.
- Manteia Technologies Co., Ltd, Xiamen, Fujian, 361008, China.
- Department of Computer and Science, School of Informatics, Xiamen University, Xiamen, Fujian, 361005, China.
- Center for Cancer, Key Laboratory of cancer Prevention and Therapy, Tianjin's Clinical Research Center for Cancer, 300060, Tianjin, China.
- Manteia Technologies Co., Ltd, Xiamen, Fujian, 361008, China. [email protected].
- Center for Cancer, Key Laboratory of cancer Prevention and Therapy, Tianjin's Clinical Research Center for Cancer, 300060, Tianjin, China. [email protected].
- Department of Radiation Oncology, Shandong Cancer Hospital and Institute, Shandong First Medical University and Shandong Academy of Medical Sciences, Jinan, Shandong, China. [email protected].
Abstract
The accurate diagnosis of lymph node metastasis in esophageal squamous cell carcinoma is crucial in the treatment workflow, and the process is often time-consuming for clinicians. Recent deep learning models predicting whether lymph nodes are affected by cancer in esophageal cancer cases suffer from challenging node delineation and hence gain poor diagnosis accuracy. This paper proposes an innovative multi-task and multi-scale attention network (M <math xmlns="http://www.w3.org/1998/Math/MathML"><mmultiscripts><mrow></mrow> <mrow></mrow> <mn>2</mn></mmultiscripts> </math> ANet) to predict lymph node metastasis precisely. The network softly expands the regions of the node mask and subsequently utilizes the expanded mask to aggregate image features, thereby amplifying the node contexts. It additionally proposes a two-branch training strategy that compels the model to simultaneously predict metastasis probability and node masks, fostering a more comprehensive learning process. The node metastasis prediction performance has been evaluated on a self-collected dataset with 177 patients. Our model finally achieves a competitive accuracy of 83.7% on the test set comprising 577 nodes. With the adaptability to intricate patterns and ability to handle data variations, M <math xmlns="http://www.w3.org/1998/Math/MathML"><mmultiscripts><mrow></mrow> <mrow></mrow> <mn>2</mn></mmultiscripts> </math> ANet emerges as a promising tool for robust and comprehensive lymph node metastasis prediction in medical image analysis.