Deep-Learning Algorithm Diagnostic Support for Usual Interstitial Pneumonia Pattern Recognition in Fibrotic Interstitial Lung Disease.
Authors
Affiliations (22)
Affiliations (22)
- Faculty of Medicine and Health, University of Sydney, Sydney, Australia.
- Faculty of Medicine, University of Queensland, Brisbane, Australia.
- Department of Respiratory Medicine, Sir Charles Gardiner Hospital, Perth, Australia.
- Institute for Respiratory Health, University of Western Australia, Perth, Australia.
- Department of Radiology, The Alfred Hospital, Melbourne, Australia.
- Department of Surgery, School of Translational Medicine, Monash University, Melbourne, Australia.
- Department of Tissue Pathology and Diagnostic Oncology, NSW Health Pathology, Royal Prince Alfred Hospital, Sydney, Australia.
- School of Medicine, Western Sydney University, Sydney, Australia.
- Department of Respiratory and Sleep Medicine, Austin Hospital, Melbourne, Australia.
- Institute for Breathing and Sleep, Melbourne, Australia.
- University of Melbourne, Melbourne, Australia.
- Royal Perth Hospital, Perth, Australia.
- University of Adelaide, Adelaide, Australia.
- Royal Adelaide Hospital, Adelaide, Australia.
- Hervey Bay Hospital, Urraween, Queensland, Australia.
- University of Queensland, Brisbane, Australia.
- School of Medicine, University of Queensland, Brisbane, Australia.
- Alfred Hospital, Melbourne, Australia.
- Monash University, Melbourne, Australia.
- Royal Prince Alfred Hospital, Sydney, Australia.
- Qureight Ltd, Cambridge, UK.
- National Heart and Lung Institute, Imperial College London, UK.
Abstract
High resolution computed tomography (HRCT) scan diagnostic classification for usual interstitial pneumonia (UIP) plays a critical role in therapeutic decision-making and clinical trial eligibility for interstitial lung disease (ILD) patients, but is subject to variability. A deep learning algorithm, the Systematic Objective Fibrotic Imaging Analysis Algorithm (SOFIA), has been validated to assist classification of HRCTs based on current guidelines. In this study, we evaluate the impact of SOFIA on inter-observer agreement for UIP classification and prognostic accuracy of clinicians' assessment of ILD HRCTs. Radiologists and pulmonologists (reviewers) were invited to evaluate 203 HRCTs from a national fibrotic ILD registry, scoring each of four UIP categories (definite UIP, probable UIP, indeterminate, or alternative diagnosis). SOFIA outputs were then provided, and reviewers were able to reevaluate their scores. Changes in interobserver agreement for UIP classification and prognostic accuracy were calculated. Three hundred twelve reviewers (120 radiologists, 192 pulmonologists) from 49 countries evaluated 203 HRCT scans. Following SOFIA, inter-observer diagnostic agreement improved for definite UIP from moderate to good (ICC<sub>pre</sub>ā=ā0.54[0.50-0.60]; ICC<sub>post</sub>ā=ā0.70[0.66-0.74]), and for probable UIP from fair to moderate (ICC<sub>pre</sub>ā=ā0.30[0.27-0.35]; ICC<sub>post</sub>ā=ā0.53[0.49-0.58]). Following SOFIA, there was improved prognostic accuracy for reviewers' definite UIP, probable UIP, and indeterminate scores (significant change in c-index), and the proportion of reviewers whose probable UIP scores were significantly predictive of transplant-free survival increased by 42%. Providing SOFIA algorithm output to clinicians reviewing HRCT scans improved diagnostic agreement and prognostic accuracy for fibrotic ILD. SOFIA may be a useful automated assistive tool to support improved diagnostic consistency.