Standardized pancreatic MRI-T1 measurement methods: comparison between manual measurement and a semi-automated pipeline with automatic quality control.
Authors
Affiliations (4)
Affiliations (4)
- Perspectum Ltd, Oxford OX4 2LL, United Kingdom.
- Department of Engineering Science, University of Oxford, Oxford OX1 3PJ, United Kingdom.
- Clinica Di Radiologia EOC, Istituto Di Imaging Della Svizzera Italiana (IIMSI), Ente Ospedaliero Cantonale, Lugano 6900, Switzerland.
- Department of Radiology, John Radcliffe Hospital, Oxford University Hospitals NHS Foundation Trust, Oxford OX3 0AG, United Kingdom.
Abstract
Scanner-referenced T1 (srT1) is a method for measuring pancreas T1 relaxation time. The purpose of this multi-centre study is 2-fold: (1) to evaluate the repeatability of manual ROI-based analysis of srT1, (2) to validate a semi-automated measurement method with an automatic quality control (QC) module to identify likely discrepancies between automated and manual measurements. Pancreatic MRI scans from a scan-rescan cohort (46 subjects) were used to evaluate the repeatability of manual analysis. Seven hundred and eight scans from a longitudinal multi-centre study of 466 subjects were divided into training, internal validation (IV), and external validation (EV) cohorts. A semi-automated method for measuring srT1 using machine learning is proposed and compared against manual analysis on the validation cohorts with and without automated QC. Inter-operator agreement between manual ROI-based method and semi-automated method had low bias (3.8 ms or 0.5%) and limits of agreement [-36.6, 44.1] ms. There was good agreement between the 2 methods without automated QC (IV: 3.2 [-47.1, 53.5] ms, EV: -0.5 [-35.2, 34.2] ms). After QC, agreement on the IV set improved, was unchanged in the EV set, and the agreement in both was within inter-operator bounds (IV: -0.04 [-33.4, 33.3] ms, EV: -1.9 [-37.6, 33.7] ms). The semi-automated method improved scan-rescan agreement versus manual analysis (manual: 8.2 [-49.7, 66] ms, automated: 6.7 [-46.7, 60.1] ms). The semi-automated method for characterization of standardized pancreatic T1 using MRI has the potential to decrease analysis time while maintaining accuracy and improving scan-rescan agreement. We provide intra-operator, inter-operator, and scan-rescan agreement values for manual measurement of srT1, a standardized biomarker for measuring pancreas fibro-inflammation. Applying a semi-automated measurement method improves scan-rescan agreement and agrees well with manual measurements, while reducing human effort. Adding automated QC can improve agreement between manual and automated measurements. We describe a method for semi-automated, standardized measurement of pancreatic T1 (srT1), which includes automated quality control. Measurements show good agreement with manual ROI-based analysis, with comparable consistency to inter-operator performance.