Back to all papers

Pulmonary Embolism Survival Prediction Using Multimodal Learning Based on Computed Tomography Angiography and Clinical Data.

Authors

Zhong Z,Zhang H,Fayad FH,Lancaster AC,Sollee J,Kulkarni S,Lin CT,Li J,Gao X,Collins S,Greineder CF,Ahn SH,Bai HX,Jiao Z,Atalay MK

Affiliations (6)

  • Department of Diagnostic Radiology, Rhode Island Hospital.
  • Warren Alpert Medical School of Brown University, Providence, RI.
  • School of Electronic Engineering, Xidian University, Xi'an, China.
  • Johns Hopkins University School of Medicine.
  • Department of Radiology and Radiological Sciences, Johns Hopkins University School of Medicine, Baltimore, MD.
  • Department of Emergency Medicine, University of Michigan, Ann Arbor, MI.

Abstract

Pulmonary embolism (PE) is a significant cause of mortality in the United States. The objective of this study is to implement deep learning (DL) models using computed tomography pulmonary angiography (CTPA), clinical data, and PE Severity Index (PESI) scores to predict PE survival. In total, 918 patients (median age 64 y, range 13 to 99 y, 48% male) with 3978 CTPAs were identified via retrospective review across 3 institutions. To predict survival, an AI model was used to extract disease-related imaging features from CTPAs. Imaging features and clinical variables were then incorporated into independent DL models to predict survival outcomes. Cross-modal fusion CoxPH models were used to develop multimodal models from combinations of DL models and calculated PESI scores. Five multimodal models were developed as follows: (1) using CTPA imaging features only, (2) using clinical variables only, (3) using both CTPA and clinical variables, (4) using CTPA and PESI score, and (5) using CTPA, clinical variables, and PESI score. Performance was evaluated using the concordance index (c-index). Kaplan-Meier analysis was performed to stratify patients into high-risk and low-risk groups. Additional factor-risk analysis was conducted to account for right ventricular (RV) dysfunction. For both data sets, the multimodal models incorporating CTPA features, clinical variables, and PESI score achieved higher c-indices than PESI alone. Following the stratification of patients into high-risk and low-risk groups by models, survival outcomes differed significantly (both P <0.001). A strong correlation was found between high-risk grouping and RV dysfunction. Multiomic DL models incorporating CTPA features, clinical data, and PESI achieved higher c-indices than PESI alone for PE survival prediction.

Topics

Pulmonary EmbolismComputed Tomography AngiographyDeep LearningJournal ArticleMulticenter Study

Ready to Sharpen Your Edge?

Join hundreds of your peers who rely on RadAI Slice. Get the essential weekly briefing that empowers you to navigate the future of radiology.

We respect your privacy. Unsubscribe at any time.