LoRA-based methods on Unet for transfer learning in aneurysmal subarachnoid hematoma segmentation.

Authors

Abstract

Aneurysmal subarachnoid hemorrhage (SAH) is a life-threatening neurological emergency with mortality rates exceeding 30%. While deep learning techniques show promise for automated SAH segmentation, their clinical application is limited by the scarcity of labeled data and challenges in cross-institutional generalization. Transfer learning from related hematoma types represents a potentially valuable but underexplored approach. Although Unet architectures remain the gold standard for medical image segmentation due to their effectiveness on limited datasets, Low-Rank Adaptation (LoRA) methods for parameter-efficient transfer learning have been rarely applied to convolutional neural networks in medical imaging contexts. The importance of SAH diagnosis and the time-intensive nature of manual annotation would benefit from automated solutions that can leverage existing multi-institutional datasets from more common conditions. We implemented a Unet architecture pre-trained on computed tomography scans from 124 traumatic brain injury patients across multiple institutions, then fine-tuned on 30 aneurysmal SAH patients from the University of Michigan Health System using 3-fold cross-validation. We developed a novel CP-LoRA method based on tensor canonical polyadic (CP) decomposition and introduced DoRA variants (DoRA-C, convDoRA, CP-DoRA) that decompose weight matrices into magnitude and directional components. We compared these approaches against existing LoRA methods (LoRA-C, convLoRA) and standard fine-tuning strategies across different modules on a multi-view Unet model. Performance was evaluated using Dice scores stratified by hemorrhage volume, with additional assessment of predicted versus annotated blood volumes. Transfer learning from traumatic brain injury to aneurysmal SAH demonstrated feasibility with all fine-tuning approaches achieving superior performance compared to no fine-tuning (mean Dice 0.410 ± 0.26). The best-performing traditional approach was decoding module fine-tuning (Dice 0.527 ± 0.20). LoRA-based methods consistently outperformed standard Unet fine-tuning, with DoRA-C at rank 64 achieving the highest overall performance (Dice 0.572 ± 0.17). Performance varied by hemorrhage volume, with all methods showing improved accuracy for larger volumes (Dice 0.682-0.694 for volumes > 100 mL vs. Dice 0.107-0.361 for volumes < 25 mL). CP-LoRA achieved comparable performance to existing methods while using significantly fewer parameters. Over-parameterization with higher ranks (64-96) consistently yielded better performance than strictly low-rank adaptations. This study demonstrates that transfer learning between hematoma types is feasible and that LoRA-based methods significantly outperform conventional Unet fine-tuning for aneurysmal SAH segmentation. The novel CP-LoRA method offers parameter efficiency advantages, while DoRA variants provide superior segmentation accuracy, particularly for small-volume hemorrhages. The finding that over-parameterization improves performance challenges traditional low-rank assumptions and suggests clinical applications may benefit from higher-rank adaptations. These results support the potential for automated SAH segmentation systems that leverage large multi-institutional traumatic brain injury datasets, potentially improving diagnostic speed and consistency when specialist expertise is unavailable.

Tags

Topics