| Title: | Towards a cardiovascular magnetic resonance foundation model for multi-task cardiac image analysis |
| Journal: | Journal of Cardiovascular Magnetic Resonance |
| Published: | 2 Oct 2025 |
| Pubmed: | https://pubmed.ncbi.nlm.nih.gov/41046013/ |
| DOI: | https://doi.org/10.1016/j.jocmr.2025.101967 |
Publication 19311
WARNING: the interactive features of this website use CSS3, which your browser does not support. To use the full features of this website, please update your browser.
Abstract
BACKGROUND: Cardiovascular magnetic resonance (CMR) is a complex imaging modality requiring a broad variety of image processing tasks for comprehensive assessment of the study. Recently, foundation models (FM) have shown promise for automated image analyses in natural images (NI). In this study, a CMR-specific vision FM was developed and then finetuned in a supervised manner for nine different imaging tasks typical to a CMR workflow, including classification, segmentation, landmark localization, and pathology detection.</p>
METHODS: A ViT-S/8 model was trained in a self-supervised manner using DINO on 36 million CMR images from 27,524 subjects from three sources (UK Biobank and two clinical centers). The model was then finetuned for nine tasks: classification (sequence, cine view), segmentation (cine SAX, cine LAX, LGE SAX, Mapping SAX), landmark localization, pathology detection (LGE, cardiac disease), on data from various sources (both public and three clinical datasets). The results were compared against metrics from state-of-the-art methods on the same tasks. A comparable baseline model was also trained on the same datasets for direct comparison. Additionally, the effect of pretraining strategy, as well as generalization and few-shot performance (training on few labeled samples) was explored for the pretrained model, compared to the baseline.</p>
RESULTS: The proposed model obtained similar performance or moderate improvements to results reported in the literature in most tasks (except disease detection), without any task-specific optimization of methodology. The proposed model outperformed the baseline in most cases, with an average increase of 6.8% points (pp) for cine view classification, and 0.1 to 1.8 pp for segmentation tasks. The proposed method also obtained generally lower standard deviations in the metrics. Improvements of 3.7 and 6.6 pp for hyperenhancement detection from LGE and 14 pp for disease detection were observed. Ablation studies highlighted the importance of pretraining strategy, architecture, and the impact of domain shifts from pretraining to finetuning. Moreover, CMR-pretrained model achieved better generalization and few-shot performance compared to the baseline.</p>
CONCLUSIONS: Vision FM specialized for medical imaging can improve accuracy and robustness over NI-FM. Self-supervised pretraining offers a resource-efficient, unified framework for CMR assessment, with the potential to accelerate the development of deep learning-based solutions for image analysis tasks, even with few annotated data available.</p>
11 Keywords
- Female
- Heart Diseases
- Humans
- Image Interpretation, Computer-Assisted
- Magnetic Resonance Imaging
- Magnetic Resonance Imaging, Cine
- Male
- Predictive Value of Tests
- Reproducibility of Results
- Supervised Machine Learning
- Workflow
6 Authors
- Athira J. Jacob
- Indraneel Borgohain
- Teodora Chitiboi
- Puneet Sharma
- Dorin Comaniciu
- Daniel Rueckert
1 Application
| Application ID | Title |
|---|---|
| 2964 | Description of cardiovascular phenotype in the UK Biobank population based on cardiovascular magnetic resonance and carotid ultrasound |
Enabling scientific discoveries that improve human health