Researchers introduce an open-source approach for evaluating AI anatomy segmentation models in medical imaging without requiring ground truth annotations.
Key Details
- 1Six open-source AI segmentation models evaluated on chest CT scans from the National Lung Screening Trial (NLST).
- 2All model outputs standardized using DICOM format and harmonized medical lexicons (SNOMED-CV) for fair comparison.
- 3Strong agreement found across models for lung segmentation, but inconsistencies and systematic errors for bones and cardiac structures.
- 4Interactive visualization tools built on OHIF Viewer and 3D Slicer plugin enabled detailed side-by-side model review.
- 5Framework and datasets are open source; enables identification of reliable models and flags problematic cases.
Why It Matters
This framework addresses a major barrier for the radiology AI field by enabling fair, evidence-based model comparison in settings lacking expert-annotated ground truth. Such approaches help researchers select appropriate AI tools for large-scale studies and highlight the variability between widely used segmentation models.
Source
EurekAlert
Related News
•EurekAlert
AI Accelerates Radiopharmaceuticals, Boosts Personalized Dosimetry in Cancer
Machine learning is driving advancements in radiopharmaceutical drug discovery and optimizing patient-specific dosimetry for precision cancer therapy.
•EurekAlert
Physicians Overly Trust Erroneous AI, Ignore Contradictory Evidence
Physicians tend to trust incorrect AI advice, even when evidence contradicts it, suggesting risks in clinical decision-making with AI tools.
•EurekAlert
Concerns Raised Over Unverified Datasets in AI Health Prediction Models
A new study finds widely used AI health prediction models are built on datasets with unverifiable origins, raising safety and validity concerns.