ChatGPT-4 demonstrates near-perfect accuracy in classifying pancreatic cysts on MRI and CT, matching radiologist performance.
Key Details
- 1Study from Memorial Sloan Kettering used ChatGPT-4 to evaluate 3,198 MRI and CT scans of 991 adults under surveillance for pancreatic cysts.
- 2ChatGPT-4 was assessed on its ability to identify nine variables crucial for monitoring cyst progression.
- 3LLM accuracy for categorical variables ranged from 97% (solid component lesions) to 99% (calcific lesions).
- 4Accuracy for continuous variables ranged from 92% (cyst size) to 97% (main pancreatic duct size).
- 5ChatGPT-4's performance was found to be equivalent to manual radiologist chart review, which is the clinical gold standard.
- 6Authors note limitation: only one AI model was tested; further research is needed.
Why It Matters
This study suggests that advanced language models like ChatGPT-4 can automate time-consuming radiological classification tasks with expert-level accuracy, potentially streamlining cyst surveillance workflows and augmenting clinical decision support.
Source
AuntMinnie
Related News
•Radiology Business
Stanford and Rad Partners Propose Framework for Evaluating Radiology AI Models
Stanford and Rad Partners developed a structured framework for pre-deployment evaluation of radiology AI models to guide purchasing decisions.
•Cardiovascular Business
Radiology Leads in FDA-Cleared Imaging AI Algorithms, Cardiology Surges
Radiology maintains its lead as the specialty with the most FDA-cleared AI algorithms, while cardiology now surpasses 200 cleared tools.
•AuntMinnie
Deep Learning CT Muscle Segmentation Enhances Sarcopenia Detection in COPD
A deep learning model for CT-based 3D pectoralis muscle segmentation outperforms standard 2D techniques in assessing muscle loss among COPD patients.