Video Transformer for Segmentation of Echocardiography Images in Myocardial Strain Measurement.
Authors
Affiliations (6)
Affiliations (6)
- Graduate Institute of Clinical Medicine, College of Medicine, National Taiwan University, Taipei, Taiwan.
- National Taiwan University Hospital, Hsin-Chu Branch, Hsinchu, Taiwan.
- Section of Cardiology, Department of Internal Medicine, National Taiwan University Hospital, No. 7, Chung-Shan S. Road, Taipei, 100225, Taiwan.
- Division of Cardiology, Department of Internal Medicine, Su Memorial Hospital, Shin Kong Wu Ho, Taipei, Taiwan.
- Institute of Electronics, National Yang Ming Chiao Tung University, Hsinchu, Taiwan.
- Section of Cardiology, Department of Internal Medicine, National Taiwan University Hospital, No. 7, Chung-Shan S. Road, Taipei, 100225, Taiwan. [email protected].
Abstract
The adoption of left ventricular global longitudinal strain (LVGLS) is still restricted by variability among various vendors and observers, despite advancements from tissue Doppler to speckle tracking imaging, machine learning, and, more recently, convolutional neural network (CNN)-based segmentation strain analysis. While CNNs have enabled fully automated strain measurement, they are inherently constrained by restricted receptive fields and a lack of temporal consistency. Transformer-based networks have emerged as a powerful alternative in medical imaging, offering enhanced global attention. Among these, the Video Swin Transformer (V-SwinT) architecture, with its 3D-shifted windows and locality inductive bias, is particularly well suited for ultrasound imaging, providing temporal consistency while optimizing computational efficiency. In this study, we propose the DTHR-SegStrain model based on a V-SwinT backbone. This model incorporates contour regression and utilizes an FCN-style multiscale feature fusion. As a result, it can generate accurate and temporally consistent left ventricle (LV) contours, allowing for direct calculation of myocardial strain without the need for conversion from segmentation to contours or any additional postprocessing. Compared to EchoNet-dynamic and Unity-GLS, DTHR-SegStrain showed greater efficiency, reliability, and validity in LVGLS measurements. Furthermore, the hybridization experiments assessed the interaction between segmentation models and strain algorithms, reinforcing that consistent segmentation contours over time can simplify strain calculations and decrease measurement variability. These findings emphasize the potential of V-SwinT-based frameworks to enhance the standardization and clinical applicability of LVGLS assessments.