ChatGPT-4 demonstrates near-perfect accuracy in classifying pancreatic cysts on MRI and CT, matching radiologist performance.
Key Details
- 1Study from Memorial Sloan Kettering used ChatGPT-4 to evaluate 3,198 MRI and CT scans of 991 adults under surveillance for pancreatic cysts.
- 2ChatGPT-4 was assessed on its ability to identify nine variables crucial for monitoring cyst progression.
- 3LLM accuracy for categorical variables ranged from 97% (solid component lesions) to 99% (calcific lesions).
- 4Accuracy for continuous variables ranged from 92% (cyst size) to 97% (main pancreatic duct size).
- 5ChatGPT-4's performance was found to be equivalent to manual radiologist chart review, which is the clinical gold standard.
- 6Authors note limitation: only one AI model was tested; further research is needed.
Why It Matters

Source
AuntMinnie
Related News

Google's Gemini Outperforms Providers in Communicating IR Procedures
Large language models like Google's Gemini demonstrate higher accuracy and greater empathy than human providers when answering patient questions about interventional radiology.

Comparing False-Positive Findings: AI vs. Radiologists in DBT Screening
AI and radiologists differ in the types and patient characteristics of false-positive findings in digital breast tomosynthesis breast cancer screening.

Aidoc Receives FDA Breakthrough Status for Multi-Condition CT AI Triage
Aidoc has received FDA Breakthrough Device status for its AI solution that flags multiple critical conditions in CT scans.