GIN-transformer based pairwise graph contrastive learning framework.
Authors
Affiliations (3)
Affiliations (3)
- School of Mathematics Science, Liaocheng University, Liaocheng Shandong, 252000, China. Electronic address: [email protected].
- School of Mathematics Science, Liaocheng University, Liaocheng Shandong, 252000, China.
- School of Mathematics Science, Liaocheng University, Liaocheng Shandong, 252000, China; School of Computer Science and Technology, Shandong Jianzhu University, Jinan Shandong, 250101, China.
Abstract
Resting-state functional magnetic resonance imaging (rs-fMRI) provides critical biomarkers for diagnosing neuropsychiatric disorders such as autism spectrum disorder (ASD) and major depressive disorder (MDD). However, existing deep learning models heavily rely on labeled data, limiting their clinical applicability. This study proposes a GIN-Transformer-based pairwise graph contrastive learning framework (GITrans-PairCL) that integrates a Graph Isomorphism Network (GIN) and Transformer to address data scarcity through unsupervised graph contrastive learning. The framework comprises two key components: a Dual-modal Contrastive Learning (DCL) module and a Task-Driven Fine-tuning (TDF) module. DCL employs sliding-window augmented rs-fMRI time series, combining GIN for modeling local spatial connectivity and Transformer for capturing global temporal dynamics, enabling multi-scale feature extraction via cross-view contrastive learning. TDF adapts the pre-trained model to downstream classification tasks. We conducted single-site and cross-site evaluation on two publicly available datasets, and the experimental results showed that GITrans-PairCL outperforms both traditional machine learning and deep learning baseline methods in automatic diagnosis of brain diseases. The model combines local and global features, and uses pre-trained contrast learning to reduce the dependence on labeling information and improve generalization.