
The CoSyn tool leverages synthetic data to help open-source AI models excel at understanding complex, text-rich images such as medical diagrams.
Key Details
- 1Penn Engineering and the Allen Institute for AI developed CoSyn to generate scientific charts and diagrams as training data for open-source vision-language models.
- 2CoSyn-400K includes over 400,000 synthetic images and 2.7 million sets of instructions, spanning scientific charts, chemical structures, and more.
- 3CoSyn-trained models outperformed proprietary systems, including GPT-4V and Gemini 1.5 Flash, on seven benchmarks.
- 4A small synthetic dataset (7,000 images) allowed their model to beat others trained on millions of real images for the NutritionQA benchmark.
- 5The approach eliminates copyright risks and supports wide, open-source access.
Why It Matters

Source
EurekAlert
Related News

AI Time Series Model Boosts EEG-Based Seizure Prediction by 44%
UC Santa Cruz engineers' 'future-guided' deep learning improves seizure prediction accuracy using EEG data.

NTU Singapore to Launch Master's in AI in Medicine for Clinicians and Technologists
NTU Singapore will launch a new MSc in Artificial Intelligence in Medicine to train clinicians and technologists in clinical AI applications from 2026.

AI Accurately Predicts Lymph Node Extension in HPV-related Throat Cancer via CT
An AI pipeline automates lymph node segmentation and extranodal extension prediction from CT in HPV-positive oropharyngeal cancer, correlating with patient outcomes.