Transparent chest radiograph foundation model enables explainable human disease profiling.
Authors
Affiliations (8)
Affiliations (8)
- Medical Technology Education Center, School of Medicine, College of Medicine, National Defense Medical University, Taipei, Taiwan, R.O.C.
- Military Digital Medical Center, Tri-Service General Hospital, National Defense Medical University, Taipei, Taiwan, R.O.C.
- Division of Family Medicine, Department of Family and Community Medicine, Tri-Service General Hospital, National Defense Medical University, Taipei, Taiwan, R.O.C.
- Department of Radiology, Tri-Service General Hospital, National Defense Medical University, Taipei, Taiwan, R.O.C.
- Division of Cardiology, Department of Internal Medicine, Tri-Service General Hospital, National Defense Medical University, Taipei, Taiwan, R.O.C.
- Division of Nephrology, Department of Internal Medicine, Tri-Service General Hospital, National Defense Medical University, Taipei, Taiwan, R.O.C.
- Medical Technology Education Center, School of Medicine, College of Medicine, National Defense Medical University, Taipei, Taiwan, R.O.C.. [email protected].
- Military Digital Medical Center, Tri-Service General Hospital, National Defense Medical University, Taipei, Taiwan, R.O.C.. [email protected].
Abstract
Chest radiography (CXR) is widely accessible, and its ability to capture subtle manifestations of systemic disease remains underexplored. We developed a contrastively pretrained multimodal CXR foundation model using large-scale image-report pairs and evaluated its capacity to predict diverse human diseases. Using 1074 phecodes derived from electronic health records, we trained linear probes on frozen image embeddings and validated performance across three independent cohorts (n = 90,911; n = 79,786; n = 60,282). The model significantly predicted 554 prevalent and 457 incident phenotypes, with 60 prevalent and 42 incident phenotypes demonstrating consistently high discrimination across all datasets. To enhance interpretability, both diseases and 57 radiologist-curated CXR features were embedded into a shared representation space. This co-embedding analysis identified 28 phenotype clusters driven by recognizable imaging patterns, including cardiomegaly, atherosclerosis, and ground-glass opacities, and enabled reconstruction of most predictions with strong explanatory performance (R² ≥ 0.85). Importantly, the embeddings captured imaging signatures associated with near-term cardiovascular events and critical illness. These findings demonstrate that CXR foundation model embeddings encode rich, clinically relevant information beyond conventional interpretation, providing a scalable and interpretable framework for comprehensive disease profiling and a foundation for future prospective validation.