MIT and collaborators developed a technique to make computer vision models, including those used in medical imaging, provide clearer, concept-based explanations for their predictions.
Key Details
- 1The new method extracts and uses concepts learned by the model during training for explanations, instead of relying solely on human-defined concepts.
- 2A sparse autoencoder and multimodal large language model are used to extract and describe these concepts in plain language.
- 3The approach limits the model to using five concepts per prediction for clarity and relevance.
- 4Compared to state-of-the-art concept bottleneck models (CBMs), this technique achieved higher accuracy and more precise explanations in tasks including medical image diagnosis.
- 5The research will be presented at the International Conference on Learning Representations, with future plans to scale the approach and address information leakage.
Why It Matters

Source
EurekAlert
Related News

AI-Powered OCT Enables Rapid 'Optical Biopsy' for Early Endometrial Cancer Detection
A team at Washington University has developed a catheter-based 3D OCT system with AI to quickly and noninvasively detect early endometrial cancers.

AI Clinical Reasoning in Diagnostics and Digital Fatigue in Healthcare
Recent JMIR features explore large language models in clinical diagnostics and digital fatigue among healthcare professionals.

KAIST, MIT, Microsoft Develop Efficient AI Image Upsampling for Robotics
KAIST, MIT, and Microsoft have created 'Upsample Anything,' a training-free AI method to restore high-resolution visual data from compressed images with up to 16x improved GPU memory efficiency.