Computer vision models (CVMs) surpass large language models (LLMs) in accurately labeling incidental breast abnormalities on chest CT scans.
Key Details
- 1Study presented at 2024 SIIM, led by University of Wisconsin researchers.
- 2Compared Covera Health’s CVM to Qwen2 7B LLM on 17,752 chest CTs in women aged 40-72 (2015–2017).
- 3Incidental breast abnormalities present in 1–7% of chest CTs; 30% of these cases are malignant.
- 4CVM had 97.5% accuracy and 81.9% sensitivity vs. LLM’s 95.7% accuracy and 39.8% sensitivity.
- 5CVM showed higher F1 score (0.81) vs. LLM (0.54); LLM had marginally higher PPV (82% vs. 79.7%).
- 6Researchers suggest continued 'AI vs AI' testing with human adjudication could aid in real-world validation.
Why It Matters
Automated detection of incidental breast findings on chest CT could reduce missed malignancies and streamline workflow. The superior sensitivity of CVMs—validated on a large real-world dataset—underscores their potential for clinical integration in radiology AI workflows.
Source
AuntMinnie
Related News
•Cardiovascular Business
Radiology Maintains Lead in FDA-Cleared AI Algorithms, Cardiology Follows
Radiology remains the top specialty for FDA-cleared AI, with cardiology as a strong second, particularly in cardiovascular imaging.
•AuntMinnie
Deep Learning Models Rival Radiologists for Pancreatic Cancer Detection on CT
Deep-learning models achieved comparable or superior accuracy to experienced radiologists in detecting pancreatic cancer on CT scans, especially for small tumors.
•Radiology Business
Radiology AI Devices at Elevated Risk for FDA Recalls, Study Finds
Radiology AI devices are more likely to face FDA recalls, largely due to deviations from intended use and incomplete clinical data.