Fusion of ConvNeXt-Tiny and Swin-Tiny backbones: a comparative analysis for diabetic retinopathy classification.
Authors
Affiliations (1)
Affiliations (1)
- School of Electronics Engineering, Vellore Institute of Technology, Vellore, India.
Abstract
Diabetic retinopathy (DR) is a leading cause of preventable blindness, which has motivated the development of reliable automated grading systems on retinal fundus images. In this study, we perform a controlled comparative evaluation of ConvNeXt-Tiny, Swin-Tiny and their feature fusion for DR classification using the Asia Pacific Tele-Ophthalmology Society (APTOS) 2019 dataset. All models were initialized with weights pre-trained on ImageNet-1K and evaluated with two transfer learning strategies: direct fine-tuning on APTOS 2019, and EyePACS-based domain adaptation with task-specific fine-tuning. Systematic ablation experiments were carried out to evaluate the contribution of Contrast Limited Adaptive Histogram Equalization (CLAHE) preprocessing and channel-spatial attention modules (CSAM). We carried out experiments on the APTOS 2019 dataset with fixed train, validation and test splits and evaluated model stability across three runs with different random seeds by reporting mean ± standard deviation of performance metrics, while performance varied widely across architectures and training settings. After domain adaptation, the fusion-based models achieved more balanced results, while the standalone Swin-Tiny showed weaker adaptation to the retinal imaging domain, and was less sensitive to subtle lesion patterns under the EyePACS-based transfer learning. Adding CLAHE preprocessing and CSAM integration did not consistently improve class-balanced metrics. The best fusion configuration achieved a mean test accuracy of 88.34% ± 1.09 and a macro F1-score of 0.7376 ± 0.0183 on the APTOS 2019 dataset across repeated runs. These results suggest that domain-specific adaptation and architectural complementarity are more beneficial in boosting DR classification performance than auxiliary preprocessing or attention enhancement. The study also emphasizes the importance of controlled comparative evaluation, stability analysis, and configuration-specific evaluation in the research of medical image classification.