Automatic identification of Parkinsonism using clinical multi-contrast brain MRI: a large self-supervised vision foundation model strategy.
Authors
Affiliations (4)
Affiliations (4)
- Department of Radiology, Institution of Radiology and Medical Imaging, West China Hospital of Sichuan University, Chengdu, 610041, Sichuan, China; Functional and Molecular Imaging Key Laboratory of Sichuan Province, West China Hospital of Sichuan University, Chengdu, 610041, Sichuan, China; Research Unit of Psychoradiology, Chinese Academy of Medical Sciences, Chengdu, 610041, Sichuan, China.
- Department of Radiology, Institution of Radiology and Medical Imaging, West China Hospital of Sichuan University, Chengdu, 610041, Sichuan, China; Functional and Molecular Imaging Key Laboratory of Sichuan Province, West China Hospital of Sichuan University, Chengdu, 610041, Sichuan, China; Research Unit of Psychoradiology, Chinese Academy of Medical Sciences, Chengdu, 610041, Sichuan, China; Department of Neurology, West China Hospital of Sichuan University, Chengdu, 610041, Sichuan, China.
- Liverpool Magnetic Resonance Imaging Centre (LiMRIC) and Institute of Life Course and Medical Sciences, University of Liverpool, Liverpool, L69 3GE, United Kingdom.
- Department of Radiology, Institution of Radiology and Medical Imaging, West China Hospital of Sichuan University, Chengdu, 610041, Sichuan, China; Functional and Molecular Imaging Key Laboratory of Sichuan Province, West China Hospital of Sichuan University, Chengdu, 610041, Sichuan, China; Research Unit of Psychoradiology, Chinese Academy of Medical Sciences, Chengdu, 610041, Sichuan, China. Electronic address: [email protected].
Abstract
Valid non-invasive biomarkers for Parkinson's disease (PD) and Parkinson-plus syndrome (PPS) are urgently needed. Based on our recent self-supervised vision foundation model the Shift Window UNET TRansformer (Swin UNETR), which uses clinical multi-contrast whole brain MRI, we aimed to develop an efficient and practical model ('SwinClassifier') for the discrimination of PD vs PPS using routine clinical MRI scans. We used 75,861 clinical head MRI scans including T1-weighted, T2-weighted and fluid attenuated inversion recovery imaging as a pre-training dataset to develop a foundation model, using self-supervised learning with a cross-contrast context recovery task. Then clinical head MRI scans from n = 1992 participants with PD and n = 1989 participants with PPS were used as a downstream PD vs PPS classification dataset. We then assessed SwinClassifier's performance in confusion matrices compared to a comparative self-supervised vanilla Vision Transformer (ViT) autoencoder ('ViTClassifier'), and to two convolutional neural networks (DenseNet121 and ResNet50) trained from scratch. SwinClassifier showed very good performance (F1 score 0.83, 95% confidence interval [CI] [0.79-0.87], AUC 0.89) in PD vs PPS discrimination in independent test datasets (n = 173 participants with PD and n = 165 participants with PPS). This self-supervised classifier with pretrained weights outperformed the ViTClassifier and convolutional classifiers trained from scratch (F1 score 0.77-0.82, AUC 0.83-0.85). Occlusion sensitivity mapping in the correctly-classified cases (n = 160 PD and n = 114 PPS) highlighted the brain regions guiding discrimination mainly in sensorimotor and midline structures including cerebellum, brain stem, ventricle and basal ganglia. Our self-supervised digital model based on routine clinical head MRI discriminated PD vs PPS with good accuracy and sensitivity. With incremental improvements the approach may be diagnostically useful in early disease. National Key Research and Development Program of China.