SST-DUNet: Smart Swin Transformer and Dense UNet for automated preclinical fMRI skull stripping.
Authors
Affiliations (5)
Affiliations (5)
- School of Information Technology, Carleton University, 1125 Colonel By Dr, Ottawa, K1S 5B6, ON, Canada. Electronic address: [email protected].
- Center for Translational NeuroImaging (CTNI), Northeastern University, 360 Huntington Ave, Boston, 02115, MA, USA.
- Department of Mathematics, College of Science and Humanity Studies, Prince Sattam Bin Abdulaziz University, Al Kharj, Riyadh, Saudi Arabia.
- Department of Psychology, Carleton University, 1125 Colonel By Drive, Ottawa, K1S 5B6, Ontario, Canada; Tessellis Ltd., 350 Legget Drive, Ottawa, K2K 0G7, Ontario, Canada.
- School of Information Technology, Carleton University, 1125 Colonel By Dr, Ottawa, K1S 5B6, ON, Canada.
Abstract
Skull stripping is a common preprocessing step in Magnetic Resonance Imaging (MRI) pipelines and is often performed manually. Automating this process is challenging for preclinical data due to variations in brain geometry, resolution, and tissue contrast. Existing methods for MRI skull stripping often struggle with the low resolution and varying slice sizes found in preclinical functional MRI (fMRI) data. This study proposes a novel method that integrates a Dense UNet-based architecture with a feature extractor based on the Smart Swin Transformer (SST), called SST-DUNet. The Smart Shifted Window Multi-Head Self-Attention (SSW-MSA) module in SST replaces the mask-based module in the Swin Transformer (ST), enabling the learning of distinct channel-wise features while focusing on relevant dependencies within brain structures. This modification allows the model to better handle the complexities of fMRI skull stripping, such as low resolution and variable slice sizes. To address class imbalance in preclinical data, a combined loss function using Focal and Dice loss is applied. The model was trained on rat fMRI images and evaluated across three in-house datasets, achieving Dice similarity scores of 98.65%, 97.86%, and 98.04%. We compared our method with conventional and deep learning-based approaches, demonstrating its superiority over state-of-the-art methods. The fMRI results using SST-DUNet closely align with those from manual skull stripping for both seed-based and independent component analyses, indicating that SST-DUNet can effectively substitute manual brain extraction in rat fMRI analysis.