ChatGPT-4 demonstrated near-perfect accuracy in extracting clinical variables from MRI and CT scans of pancreatic cyst patients, equalling manual chart review by radiologists.
Key Details
- 1Study involved 991 patients with 3,198 MRI and CT scans from Memorial Sloan Kettering (2010–2024).
- 2ChatGPT-4 extracted 9 critical clinical variables with accuracy rates of 92%–99%.
- 3AI matched the manual approach, considered the gold standard, for classifying high-risk variables such as cyst size and solid component presence.
- 4Efficiency and cost-effectiveness cited as major advantages of the AI approach.
- 5The study was published in the Journal of the American College of Surgeons and NIH/NCI partially funded the work.
Why It Matters
Demonstrating LLMs’ ability to accurately extract structured data from radiology imaging reports could streamline large-scale research and surveillance tasks, reducing costs and improving patient care efficiency. This proof-of-concept signals the increasing feasibility and trustworthiness of leveraging advanced AI models in radiological workflows.
Source
EurekAlert
Related News
•EurekAlert
AutoML Model Accurately Differentiates Brain Tumors on MRI
Thomas Jefferson University researchers developed an AutoML model that distinguishes pituitary macroadenomas from parasellar meningiomas on MRI with over 97% accuracy.
•EurekAlert
AI Model Improves Differentiation of Brain Tumor Progression from Radiation Necrosis on MRI
A York University-led study shows a novel AI using advanced MRI can distinguish between progressive brain tumors and radiation necrosis more accurately than human assessment.
•EurekAlert
Survey: Public Trusts Doctors Over AI, But Embraces AI For Cancer Diagnosis
Most people trust doctors more than AI for health diagnoses, but see significant potential for AI tools in cancer detection.