The Use of Artificial Intelligence to Improve Detection of Acute Incidental Pulmonary Emboli.
Authors
Affiliations (4)
Affiliations (4)
- Mayo Clinic, Department of Radiology, 200 First Street SW, Rochester, MN 55905, USA. Electronic address: [email protected].
- Stanford University, Department of Radiology, 300 Pasteur Drive, MC5105, Stanford, CA 94305.
- Mayo Clinic, Department of Radiology, 200 First Street SW, Rochester, MN 55905.
- Mayo Clinic, Department of Cardiovascular Medicine, 200 First Street SW, Rochester, MN 55905.
Abstract
Incidental pulmonary emboli (IPE) are frequently overlooked by radiologists. Artificial intelligence (AI) algorithms have been developed to aid detection of pulmonary emboli. To measure diagnostic performance of AI compared with prospective interpretation by radiologists. A commercially available AI algorithm was used to retrospectively review 14,453 contrast-enhanced outpatient CT CAP exams in 9171 patients where PE was not clinically suspected. Natural language processing (NLP) searches of reports identified IPE detected prospectively. Thoracic radiologists reviewed all cases read as positive by AI or NLP to confirm IPE and assess the most proximal level of clot and overall clot burden. 1,400 cases read as negative by both the initial radiologist and AI were re-reviewed to assess for additional IPE. Radiologists prospectively detected 218 IPE and AI detected an additional 36 unreported cases. AI missed 30 cases of IPE detected by the radiologist and had 94 false positives. For 36 IPE missed by the radiologist, median clot burden was 1 and 19 were solitary segmental or subsegmental. For 30 IPE missed by AI, one case had large central emboli and the others were small with 23 solitary subsegmental emboli. Radiologist re-review of 1,400 exams interpreted as negative found 8 additional cases of IPE. Compared with radiologists, AI had similar sensitivity but reduced positive predictive value. Our experience indicates that the AI tool is not ready to be used autonomously without human oversight, but a human observer plus AI is better than either alone for detection of incidental pulmonary emboli.