Clinical artificial intelligence applications of vision-language foundation models.
Authors
Affiliations (9)
Affiliations (9)
- Department of Clinical Neurosciences, Medical Sciences Division, University of Oxford, Oxford, United Kingdom.
- International Centre for Eye Health, London School of Hygiene and Tropical Medicine, London, United Kingdom.
- School of Electronic Engineering and Computer Science, Queen Mary University of London, London, United Kingdom.
- School of Engineering, College of Engineering and Physical Sciences, University of Birmingham, Birmingham, United Kingdom.
- Meta AI, Meta Platforms Inc., Menlo Park, California, United States of America.
- Heidi Health, Melbourne, Australia.
- Institute for Safe Autonomy, University of York, York, United Kingdom.
- Ufonia Ltd., Oxford, United Kingdom.
- Moorfields Eye Hospital NHS Foundation Trust, London, United Kingdom.
Abstract
Vision-language models (VLMs) represent a transformative advance in generative artificial intelligence (AI), using multimodal data processing to enhance clinical decision-making and workflow efficiency. Built on transformer architectures, VLMs excel in tasks like image interpretation, report generation, and visual question-answering, with emerging applications in radiology, pathology, and broader clinical practice. Their potential extends to automating documentation, improving medical education, and assisting with clinical decision-making in real-time. However, successful integration requires rigorous validation to address challenges such as bias, interpretability, and safety concerns. Prospective clinical trials, health economic evaluations, and stakeholder engagement are essential to ensure equitable and effective deployment. Regulatory frameworks must evolve to accommodate VLM functionality while maintaining accountability and protecting patient safety. By balancing innovation with robust oversight, VLMs hold promise in reducing clinician workload, expanding access to expert care, and advancing precision medicine-ushering in a new era of AI-augmented healthcare.