Standardized pancreatic MRI-T1 measurement methods: comparison between manual measurement and a semi-automated pipeline with automatic quality control.

OBJECTIVES: Scanner-referenced T1 (srT1) is a method for measuring pancreas T1 relaxation time. The purpose of this multi-centre study is 2-fold: (1) to evaluate the repeatability of manual ROI-based analysis of srT1, (2) to validate a semi-automated measurement method with an automatic quality control (QC) module to identify likely discrepancies between automated and manual measurements. METHODS: Pancreatic MRI scans from a scan-rescan cohort (46 subjects) were used to evaluate the repeatability of manual analysis. Seven hundred and eight scans from a longitudinal multi-centre study of 466 subjects were divided into training, internal validation (IV), and external validation (EV) cohorts. A semi-automated method for measuring srT1 using machine learning is proposed and compared against manual analysis on the validation cohorts with and without automated QC. RESULTS: Inter-operator agreement between manual ROI-based method and semi-automated method had low bias (3.8 ms or 0.5%) and limits of agreement [-36.6, 44.1] ms. There was good agreement between the 2 methods without automated QC (IV: 3.2 [-47.1, 53.5] ms, EV: -0.5 [-35.2, 34.2] ms). After QC, agreement on the IV set improved, was unchanged in the EV set, and the agreement in both was within inter-operator bounds (IV: -0.04 [-33.4, 33.3] ms, EV: -1.9 [-37.6, 33.7] ms). The semi-automated method improved scan-rescan agreement versus manual analysis (manual: 8.2 [-49.7, 66] ms, automated: 6.7 [-46.7, 60.1] ms). CONCLUSIONS: The semi-automated method for characterization of standardized pancreatic T1 using MRI has the potential to decrease analysis time while maintaining accuracy and improving scan-rescan agreement. ADVANCES IN KNOWLEDGE: We provide intra-operator, inter-operator, and scan-rescan agreement values for manual measurement of srT1, a standardized biomarker for measuring pancreas fibro-inflammation. Applying a semi-automated measurement method improves scan-rescan agreement and agrees well with manual measurements, while reducing human effort. Adding automated QC can improve agreement between manual and automated measurements. SUMMARY STATEMENT: We describe a method for semi-automated, standardized measurement of pancreatic T1 (srT1), which includes automated quality control. Measurements show good agreement with manual ROI-based analysis, with comparable consistency to inter-operator performance.