Stanford and Rad Partners developed a structured framework for pre-deployment evaluation of radiology AI models to guide purchasing decisions.
Key Details
- 1Framework was developed by Stanford University and Rad Partners, detailed in the American Journal of Roentgenology.
- 2A workgroup of four radiologists evaluated 13 AI models from one vendor (Aidoc) between 2022 and 2024.
- 3Nearly 89,000 exams across multiple sites were used in the assessment.
- 4Attributes for evaluating value included task tediousness, likelihood of radiologist oversight, and clinical impact of misses.
- 5Five tasks were rated as high value, five as medium, and two as low based on the framework.
Why It Matters
This framework provides radiology groups with a practical, evidence-based method to evaluate AI models before investment, addressing the gap between AI marketing claims and real-world outcomes. Adoption of such structured assessment tools can improve clinical effectiveness and ROI for AI integration in imaging practices.
Source
Radiology Business
Related News
•HealthExec
Mayo Clinic Sued Over Alleged AI Improprieties and Whistleblower Retaliation
A former Mayo Clinic research director sues the institution, alleging retaliation after raising concerns about improper AI use affecting patient safety and data integrity.
•Radiology Business
Framework Assesses Real-World Financial Impact of Radiology AI Adoption
A new analysis presents a financial calculator for objectively assessing the return on investment (ROI) of implementing radiology AI solutions.
•Radiology Business
AI Technique Unveils Previously Hidden MS Gray Matter Lesions on MRI
Researchers developed an AI-enhanced method to detect previously invisible gray matter lesions in multiple sclerosis using MRI.