University of Toronto researchers found that large language models (LLMs) such as DeepSeek V3 and GPT-4o offer promising support for radiology decision-making in pancreatic cancer when their recommendations cite guideline sources.
Key Details
- 1LLMs were tested for generating NCCN-compliant management plans for 328 pancreatic ductal adenocarcinoma (PDAC) cases.
- 2DeepSeek V3 had a 100% completion rate and 1.5% discordance; GPT-4o had a 96.3% completion rate and 8.8% discordance, a statistically significant difference.
- 3Both LLMs had high (>91%) category-specific concordance, though DeepSeek outperformed GPT-4o—except GPT-4o had 86% for locally advanced nonresectable cancer.
- 4Radiologist review flagged occasional inaccurate recommendations, including misclassification of tumor resectability and overtreatment.
- 5Researchers emphasized that LLM explainability and the ability to cite guidelines are key for clinical trust and workflow integration.
Why It Matters
Effective and explainable LLM integration could enhance radiology workflow efficiency and clinical safety, especially where multidisciplinary tumor board processes are resource-intensive. Citation of guideline sources is essential for radiologist trust and broader adoption of AI tools in oncology decision-making.
Source
AuntMinnie
Related News
•AuntMinnie
Study: Computer Vision Models Best LLMs in Chest CT Breast Abnormality Detection
Computer vision models (CVMs) surpass large language models (LLMs) in accurately labeling incidental breast abnormalities on chest CT scans.
•Cardiovascular Business
Radiology Maintains Lead in FDA-Cleared AI Algorithms, Cardiology Follows
Radiology remains the top specialty for FDA-cleared AI, with cardiology as a strong second, particularly in cardiovascular imaging.
•AuntMinnie
Deep Learning Models Rival Radiologists for Pancreatic Cancer Detection on CT
Deep-learning models achieved comparable or superior accuracy to experienced radiologists in detecting pancreatic cancer on CT scans, especially for small tumors.