ChatGPT-4 demonstrates near-perfect accuracy in classifying pancreatic cysts on MRI and CT, matching radiologist performance.
Key Details
- 1Study from Memorial Sloan Kettering used ChatGPT-4 to evaluate 3,198 MRI and CT scans of 991 adults under surveillance for pancreatic cysts.
- 2ChatGPT-4 was assessed on its ability to identify nine variables crucial for monitoring cyst progression.
- 3LLM accuracy for categorical variables ranged from 97% (solid component lesions) to 99% (calcific lesions).
- 4Accuracy for continuous variables ranged from 92% (cyst size) to 97% (main pancreatic duct size).
- 5ChatGPT-4's performance was found to be equivalent to manual radiologist chart review, which is the clinical gold standard.
- 6Authors note limitation: only one AI model was tested; further research is needed.
Why It Matters
This study suggests that advanced language models like ChatGPT-4 can automate time-consuming radiological classification tasks with expert-level accuracy, potentially streamlining cyst surveillance workflows and augmenting clinical decision support.
Source
AuntMinnie
Related News
•Radiology Business
Medicare Denies Over Half of Radiology AI Claims, Study Finds
Medicare denied $16 million in radiology AI claims between 2018 and 2023, rejecting over half submitted.
•Health Imaging
AI Model Improves Short-Term Breast Cancer Risk Prediction
AI models combining mammography and clinical data improve identification of women at high short-term breast cancer risk.
•AuntMinnie
Medicare Covers Half of Radiology SaaS AI Claims, Study Finds
Medicare reimbursed only about 47% of radiology SaaS AI claims between 2018 and 2023, denying over $16 million in payments.