AI models for cancer pathology often rely on shortcut correlations rather than detecting true biological signals, compromising reliability.
Key Details
- 1University of Warwick research analyzed 8,000+ patient samples across four cancer types using deep learning pathology models.
- 2Findings show many models predict biomarkers based on confounded visual cues, not causal biological features.
- 3AI models' headline accuracy can drop markedly when evaluated in stratified subgroups controlling for confounding factors.
- 4Reported accuracy for AI (just over 80%) was only modestly better than using tumour grade alone (~75%), already assessed by pathologists.
- 5Authors stress need for bias-aware evaluation and subgroup testing to prevent premature and unsafe clinical deployment.
Why It Matters
This research underscores significant risks of overrelying on AI diagnostic tools that may not generalize well in real-world settings. Robustness, causal modeling, and rigorous validation standards are essential before AI can safely supplement or replace human expertise in pathology and radiology.
Source
EurekAlert
Related News
•EurekAlert
AI Accelerates Radiopharmaceuticals, Boosts Personalized Dosimetry in Cancer
Machine learning is driving advancements in radiopharmaceutical drug discovery and optimizing patient-specific dosimetry for precision cancer therapy.
•EurekAlert
Physicians Overly Trust Erroneous AI, Ignore Contradictory Evidence
Physicians tend to trust incorrect AI advice, even when evidence contradicts it, suggesting risks in clinical decision-making with AI tools.
•EurekAlert
Concerns Raised Over Unverified Datasets in AI Health Prediction Models
A new study finds widely used AI health prediction models are built on datasets with unverifiable origins, raising safety and validity concerns.