Machine learning-based risk prediction of outcomes in patients hospitalized with COVID-19 in Australia: the AUS-COVID Score.
Authors
Affiliations (6)
Affiliations (6)
- Department of Cardiology, Royal North Shore Hospital, Sydney, NSW 2065, Australia.
- Faculty of Medicine and Health, University of Sydney, Sydney, NSW 2006, Australia.
- Department of Cardiology, Northern Hospital, Melbourne, VIC 3076, Australia.
- Faculty of Medicine, University of Melbourne, Melbourne, VIC 3010, Australia.
- Department of Cardiology, Concord Repatriation General Hospital, Sydney, NSW 2138, Australia.
- Westmead Applied Research Centre and Department of Cardiology, Westmead Hospital, Sydney, NSW 2145, Australia.
Abstract
We aimed to develop a highly interpretable and effective, machine learning (ML)-based risk prediction algorithm to predict in-hospital mortality, intubation, and adverse cardiovascular events in patients hospitalized with coronavirus disease 2019 (COVID-19) in Australia (AUS-COVID Score). This prospective study across 21 hospitals included 1714 consecutive patients aged ≥ 18 in their index hospitalization with COVID-19. The dataset was separated into training (80%) and test sets (20%). Eight supervised ML methods were used: least absolute shrinkage and selection operator (LASSO), ridge, elastic net (EN), decision tree, support vector machine, random forest, AdaBoost, and gradient boosting. A feature selection method was used to establish informative variables, which were considered in groups of 5/10/15/20/all. The final model was selected by balancing the optimal area under the curve (AUC) score with interpretability, through the number of included variables. The coefficients of the final models were used to build the AUS-COVID Score. Among the patients, 181 (10.6%) died in-hospital, 148 (8.6%) required intubation, and 90 (5.3%) had adverse cardiovascular events. The LASSO model performed best for predicting in-hospital mortality (AUC 0.85) using 5 variables: age, respiratory rate, COVID-19 features on chest X-ray, troponin elevation, and COVID-19 vaccination (≥1 dose). The EN model performed best for predicting intubation (AUC 0.75) and adverse cardiovascular events (AUC 0.64), each with 5 variables. A user-friendly web-based application was built for clinician use at the bedside. The AUS-COVID Score is an accurate and practical, ML-based risk score to predict in-hospital mortality, intubation, and adverse cardiovascular events in hospitalized COVID-19 patients.