Large language models demonstrate promising performance in automating PI-RADS classification from structured prostate MRI reports, with some limitations in intermediate-risk lesions.
Key Details
- 1Study included 146 structured prostate MRI reports from October 2023 to October 2024.
- 2Four LLMs compared: GPT-4o, GPT-o1, Google Gemini 1.5 Pro, Google Gemini 2.0 Experimental Advanced.
- 3Radiologist consensus used as ground truth; Cohen's kappa measured agreement.
- 4GPT-o1 achieved the highest agreement (kappa = 0.87) and perfect F1 score (1.00) for high-risk PI-RADS category.
- 5All LLMs struggled with PI-RADS 3 (equivocal risk) category (F1 scores 0.53–0.75).
- 6Authors recommend further multicenter validation and larger datasets before clinical adoption.
Why It Matters
Automating PI-RADS classification could streamline prostate MRI reporting, reduce variability, and enhance workflow efficiency for radiologists. However, challenges in intermediate-risk lesion classification underscore the need for more robust validation before real-world clinical use.
Source
AuntMinnie
Related News
•AuntMinnie
AI-CAD Boosts Specificity and Efficiency in Asia-Pacific Mammography Study
AI-CAD systems increased specificity and cut interpretation times in a multicenter Asia-Pacific mammography study.
•AuntMinnie
AI-Driven Mammogram Analysis Boosts Cardiovascular Risk Prediction in Women
AI quantification of breast arterial calcifications (BACs) on mammograms enhances prediction of cardiovascular events beyond traditional risk models.
•AuntMinnie
ChatGPT Demonstrates High Diagnostic Agreement on FDG-PET/CT Reports
ChatGPT-4o and ChatGPT-5 matched or surpassed nuclear medicine experts in diagnosing neurodegenerative diseases using textual FDG-PET/CT scan descriptions.