Stanford and Rad Partners developed a structured framework for pre-deployment evaluation of radiology AI models to guide purchasing decisions.
Key Details
- 1Framework was developed by Stanford University and Rad Partners, detailed in the American Journal of Roentgenology.
- 2A workgroup of four radiologists evaluated 13 AI models from one vendor (Aidoc) between 2022 and 2024.
- 3Nearly 89,000 exams across multiple sites were used in the assessment.
- 4Attributes for evaluating value included task tediousness, likelihood of radiologist oversight, and clinical impact of misses.
- 5Five tasks were rated as high value, five as medium, and two as low based on the framework.
Why It Matters
This framework provides radiology groups with a practical, evidence-based method to evaluate AI models before investment, addressing the gap between AI marketing claims and real-world outcomes. Adoption of such structured assessment tools can improve clinical effectiveness and ROI for AI integration in imaging practices.
Source
Radiology Business
Related News
•Radiology Business
AI Guidance Cuts Novice Ultrasound Exam Time by 34%
AI guidance significantly reduces exam times and enhances diagnostic quality for novice ultrasound operators performing shoulder exams.
•AuntMinnie
AI Models Reveal Racial Disparities in Breast Cancer Patterns
Machine learning models reveal significant racial disparities and key predictors in breast cancer incidence across diverse groups.
•Radiology Business
UCLA Appoints Inaugural Associate Dean for Health AI Strategy
UCLA has appointed Katherine P. Andriole as its first associate dean for Health AI Strategy and Innovation, with an initial focus on radiology.