ChatGPT-4 demonstrates near-perfect accuracy in classifying pancreatic cysts on MRI and CT, matching radiologist performance.
Key Details
- 1Study from Memorial Sloan Kettering used ChatGPT-4 to evaluate 3,198 MRI and CT scans of 991 adults under surveillance for pancreatic cysts.
- 2ChatGPT-4 was assessed on its ability to identify nine variables crucial for monitoring cyst progression.
- 3LLM accuracy for categorical variables ranged from 97% (solid component lesions) to 99% (calcific lesions).
- 4Accuracy for continuous variables ranged from 92% (cyst size) to 97% (main pancreatic duct size).
- 5ChatGPT-4's performance was found to be equivalent to manual radiologist chart review, which is the clinical gold standard.
- 6Authors note limitation: only one AI model was tested; further research is needed.
Why It Matters
This study suggests that advanced language models like ChatGPT-4 can automate time-consuming radiological classification tasks with expert-level accuracy, potentially streamlining cyst surveillance workflows and augmenting clinical decision support.

Source
AuntMinnie
Related News

•AuntMinnie
AI Tool Mirai Shows Robust Performance for Interval Breast Cancer Detection
The Mirai AI model significantly improves detection of interval breast cancers in negative screening mammograms.

•Radiology Business
AI Tool Predicts Interval Breast Cancer Risk from Negative Mammograms
AI can predict interval breast cancer risk up to three years after a negative mammogram.

•Radiology Business
AI Outperforms Radiologists in Predicting Lung Cancer Treatment Response
AI tools demonstrate higher accuracy than radiologists in predicting lung cancer treatment response from imaging studies.