Latest multimodal large language models show limitations on image-based radiology exam questions.
Key Details
- 1Researchers tested ChatGPT-4v and ChatGPT-4o on 222 image-based multiple-choice questions from national radiology board exams (2020 and 2024).
- 2These LLMs have been recently trained to process both text and images.
- 3Despite advancements, significant concerns remain regarding their reliability for diagnostic tasks in radiology.
- 4The potential of such models in radiology workflows, such as report generation and diagnostic support, is still under early investigation.
Why It Matters
As large language models gain capability for image analysis, assessing their reliability is crucial for safe deployment in radiology. Failures on board-style questions highlight the need for ongoing scrutiny before clinical trust is warranted.
Source
Radiology Business
Related News
•AuntMinnie
AI's Evolving Role in Tackling Radiology Workforce Shortages
AI technologies are emerging as key tools to alleviate radiology workforce shortages by improving efficiency and supporting clinical workflows.
•Radiology Business
Nvidia Unveils Explainable AI Models Mimicking Radiologist Reasoning
Nvidia introduces Clara Reason, a suite of explainable AI models designed to emulate radiologist workflows for interpreting medical images.
•Radiology Business
Mallinckrodt Institute Launches Center for AI Imaging Innovation
Mallinckrodt Institute of Radiology is establishing a center to advance AI-based imaging technologies in collaboration with other Washington University units.