Stanford and Rad Partners developed a structured framework for pre-deployment evaluation of radiology AI models to guide purchasing decisions.
Key Details
- 1Framework was developed by Stanford University and Rad Partners, detailed in the American Journal of Roentgenology.
- 2A workgroup of four radiologists evaluated 13 AI models from one vendor (Aidoc) between 2022 and 2024.
- 3Nearly 89,000 exams across multiple sites were used in the assessment.
- 4Attributes for evaluating value included task tediousness, likelihood of radiologist oversight, and clinical impact of misses.
- 5Five tasks were rated as high value, five as medium, and two as low based on the framework.
Why It Matters
This framework provides radiology groups with a practical, evidence-based method to evaluate AI models before investment, addressing the gap between AI marketing claims and real-world outcomes. Adoption of such structured assessment tools can improve clinical effectiveness and ROI for AI integration in imaging practices.
Source
Radiology Business
Related News
•AuntMinnie
Deep Learning Model Predicts Brain Tumor MRI Enhancement Without Gadolinium
German researchers developed a deep learning approach to predict MRI contrast enhancement in brain tumors without the need for gadolinium-based agents.
•Radiology Business
Study Highlights Limitations of AI in Prostate MRI Screening
New research points to several shortcomings in implementing AI for MRI-based prostate cancer screening.
•AuntMinnie
Multimodal LLMs Achieve High Accuracy Detecting Scoliosis on X-rays
Multimodal LLMs achieved up to 94% accuracy for scoliosis detection on spine x-rays, but struggled with lumbar stenosis on MRI.