Many real-world settings require registration of a pair of medical images that differ in spatial resolution, which may arise from differences in image acquisition parameters like pixel spacing, slice thickness, and field-of-view. However, all previous machine learning-based registration techniques resample images onto a fixed resolution. This is suboptimal because resampling can introduce artifacts due to interpolation. To address this, we present RealKeyMorph (RKM), a resolution-agnostic method for image registration. RKM is an extension of KeyMorph, a registration framework which works by training a network to learn corresponding keypoints for a given pair of images, after which a closed-form keypoint matching step is used to derive the transformation that aligns them. To avoid resampling and enable operating on the raw data, RKM outputs keypoints in real-world coordinates of the scanner. To do this, we leverage the affine matrix produced by the scanner (e.g., MRI machine) that encodes the mapping from voxel coordinates to real world coordinates. By transforming keypoints into real-world space and integrating this into the training process, RKM effectively enables the extracted keypoints to be resolution-agnostic. In our experiments, we demonstrate the advantages of RKM on the registration task for orthogonal 2D stacks of abdominal MRIs, as well as 3D volumes with varying resolutions in brain datasets.

Background and Objective: Prototype-based methods improve interpretability by learning fine-grained part-prototypes; however, their visualization in the input pixel space is not always consistent with human-understandable biomarkers. In addition, well-known prototype-based approaches typically learn extremely granular prototypes that are less interpretable in medical imaging, where both the presence and extent of biomarkers and lesions are critical. Methods: To address these challenges, we propose PiPViT (Patch-based Visual Interpretable Prototypes), an inherently interpretable prototypical model for image recognition. Leveraging a vision transformer (ViT), PiPViT captures long-range dependencies among patches to learn robust, human-interpretable prototypes that approximate lesion extent only using image-level labels. Additionally, PiPViT benefits from contrastive learning and multi-resolution input processing, which enables effective localization of biomarkers across scales. Results: We evaluated PiPViT on retinal OCT image classification across four datasets, where it achieved competitive quantitative performance compared to state-of-the-art methods while delivering more meaningful explanations. Moreover, quantitative evaluation on a hold-out test set confirms that the learned prototypes are semantically and clinically relevant. We believe PiPViT can transparently explain its decisions and assist clinicians in understanding diagnostic outcomes. Github page: https://github.com/marziehoghbaie/PiPViT

Recent advances in medical imaging have established deep learning-based segmentation as the predominant approach, though it typically requires large amounts of manually annotated data. However, obtaining annotations for intracranial hemorrhage (ICH) remains particularly challenging due to the tedious and costly labeling process. Semi-supervised learning (SSL) has emerged as a promising solution to address the scarcity of labeled data, especially in volumetric medical image segmentation. Unlike conventional SSL methods that primarily focus on high-confidence pseudo-labels or consistency regularization, we propose SWDL-Net, a novel SSL framework that exploits the complementary advantages of Laplacian pyramid and deep convolutional upsampling. The Laplacian pyramid excels at edge sharpening, while deep convolutions enhance detail precision through flexible feature mapping. Our framework achieves superior segmentation of lesion details and boundaries through a difference learning mechanism that effectively integrates these complementary approaches. Extensive experiments on a 271-case ICH dataset and public benchmarks demonstrate that SWDL-Net outperforms current state-of-the-art methods in scenarios with only 2% labeled data. Additional evaluations on the publicly available Brain Hemorrhage Segmentation Dataset (BHSD) with 5% labeled data further confirm the superiority of our approach. Code and data have been released at https://github.com/SIAT-CT-LAB/SWDL.

This study aims to explore the feasibility to automate the application process of nomograms in clinical medicine, demonstrated through the task of preoperative pleural invasion prediction in non-small cell lung cancer patients using PET/CT imaging. The automatic pipeline involves multimodal segmentation, feature extraction, and model prediction. It is validated on a cohort of 1116 patients from two medical centers. The performance of the feature-based diagnostic model outperformed both the radiomics model and individual machine learning models. The segmentation models for CT and PET images achieved mean dice similarity coefficients of 0.85 and 0.89, respectively, and the segmented lung contours showed high consistency with the actual contours. The automatic diagnostic system achieved an accuracy of 0.87 in the internal test set and 0.82 in the external test set, demonstrating comparable overall diagnostic performance to the human-based diagnostic model. In comparative analysis, the automatic diagnostic system showed superior performance relative to other segmentation and diagnostic pipelines. The proposed automatic diagnostic system provides an interpretable, automated solution for predicting pleural invasion in non-small cell lung cancer.

Benign lymph node enlargement can mislead surgeons into overstaging colorectal cancer (CRC), causing unnecessarily extended lymphadenectomy. This study aimed to develop and validate a machine learning (ML) classifier utilizing multi-phase CT (MPCT) radiomics for accurate evaluation of the pre-treatment status of enlarged tumor-draining lymph nodes (TDLNs; defined as long-axis diameter ≥ 10 mm). This study included 430 pathologically confirmed CRC patients who underwent radical resection, stratified into a development cohort (n = 319; January 2015-December 2019, retrospectively enrolled) and test cohort (n = 111; January 2020-May 2023, prospectively enrolled). Radiomics features were extracted from multi-regional lesions (tumor and enlarged TDLNs) on MPCT. Following rigorous feature selection, optimal features were employed to train multiple ML classifiers. The top-performing classifier based on area under receiver operating characteristic curves (AUROCs) was validated. Ultimately, 15 classifiers based on features from multi-regional lesions were constructed (Tumor_{N, A}, _V; Ln_N, _A, _V; Ln, lymph node; _N, non-contrast phase; _A, arterial phase; _V, venous phase). Among all classifiers, the enlarged TDLNs fusion MPCT classifier (Ln_NAV) demonstrated the highest predictive efficacy, with AUROCs and AUPRCs of 0.820 and 0.883, respectively. When pre-treatment clinical variables were integrated (Clinical_Ln_NAV), the model's efficacy improved, with AUROCs of 0.839, AUPRCs of 0.903, accuracy of 76.6%, sensitivity of 67.7%, and specificity of 89.1%. The classifier Clinical_Ln_NAV demonstrated well performance in evaluating pre-treatment status of enlarged TDLNs. This tool may support clinicians in developing individualized treatment plans for CRC patients, helping to avoid inappropriate treatment. Question There are currently no effective non-invasive tools to assess the status of enlarged tumor-draining lymph nodes in colorectal cancer prior to treatment. Findings Pre-treatment multi-phase CT radiomics, combined with clinical variables, effectively assessed the status of enlarged tumor-draining lymph nodes, achieving a specificity of 89.1%. Clinical relevance statement The multi-phase CT-based classifier may assist clinicians in developing individualized treatment plans for colorectal cancer patients, potentially helping to avoid inappropriate preoperative adjuvant therapy and unnecessary extended lymphadenectomy.

Dental implant surgery has become a prevalent treatment option for patients with single tooth defects. However, the success of this surgery relies heavily on precise planning and execution. This study investigates the application of artificial intelligence (AI) in assisting the planning process of dental implant surgery for single tooth defects. Single tooth defects in the oral cavity pose a significant challenge in restorative dentistry. Dental implant restoration has emerged as an effective solution for rehabilitating such defects. However, the complexity of the procedure and the need for accurate treatment planning necessitate the integration of advanced technologies. In this study, we propose the utilisation of AI to enhance the precision and efficiency of implant surgery planning for single tooth defects. A total of twenty patients with single tooth loss were enrolled. Cone-beam computed tomography (CBCT) and intra-oral scans were obtained and imported into the AI-dentist software for 3D reconstruction. AI assisted in implant selection, tooth position identification, and crown fabrication. Evaluation included subjective verification and objective assessments. A paired samples t-test was used to compare planning times (dentist vs. AI), with a significance level of p < 0.05. Twenty patients (9 male, 11 female; mean age 59.5 ± 11.86 years) with single missing teeth participated in this study. Implant margins were carefully positioned: 3.05 ± 1.44 mm from adjacent roots, 2.52 ± 0.65 mm from bone plate edges, 3.05 ± 1.44 mm from sinus/canal, and 3.85 ± 1.23 mm from gingival height. Manual planning (21.50 ± 4.87 min) was statistically significantly slower than AI (11.84 ± 3.22 min, p < 0.01). Implant planning met 100% buccolingual/proximal/distal bone volume criteria and 90% sinus/canal distance criteria. Two patients required sinus lifting and bone grafting due to insufficient bone volume. This study highlights the promising role of AI in enhancing the precision and efficiency of dental implant surgery planning for single tooth defects. Further studies are necessary to validate the effectiveness and safety of AI-assisted planning in a larger patient population.

To develop a deep learning (DL) model for predicting disease-free survival (DFS) in clinical stage I lung cancer patients who underwent surgical resection using pre-treatment CT images, and further validate it in patients receiving stereotactic body radiation therapy (SBRT). A retrospective cohort of 2489 clinical stage I non-small cell lung cancer (NSCLC) patients treated with operation (2015-2017) was enrolled to develop a DL-based DFS prediction model. Tumor features were extracted from CT images using a three-dimensional convolutional neural network. External validation was performed on 248 clinical stage I patients receiving SBRT from two hospitals. A clinical model was constructed by multivariable Cox regression for comparison. Model performance was evaluated with Harrell's concordance index (C-index), which measures the model's ability to correctly rank survival times by comparing all possible pairs of subjects. In the surgical cohort, the DL model effectively predicted DFS with a C-index of 0.85 (95% CI: 0.80-0.89) in the internal testing set, significantly outperforming the clinical model (C-index: 0.76). Based on the DL model, 68 patients in the SBRT cohort identified as high-risk had significantly worse DFS compared to the low-risk group (p < 0.01, 5-year DFS rate: 34.7% vs 77.4%). The DL-score was demonstrated to be an independent predictor of DFS in both cohorts (p < 0.01). The CT-based DL model improved DFS prediction in clinical stage I lung cancer patients, identifying populations at high risk of recurrence and metastasis to guide clinical decision-making. Question The recurrence or metastasis rate of early-stage lung cancer remains high and varies among patients following radical treatments such as surgery or SBRT. Findings This CT-based DL model successfully predicted DFS and stratified varying disease risks in clinical stage I lung cancer patients undergoing surgery or SBRT. Clinical relevance The CT-based DL model is a reliable predictive tool for the prognosis of early-stage lung cancer. Its accurate risk stratification assists clinicians in identifying specific patients for personalized clinical decision making.

To investigate the feasibility of accelerated MRI with artificial intelligence-assisted compressed sensing (ACS) technique in the temporomandibular joint (TMJ) and compare its performance with parallel imaging (PI) protocol and standard (STD) protocol. Participants with TMJ-related symptoms were prospectively enrolled from April 2023 to May 2024, and underwent bilateral TMJ imaging examinations using ACS protocol (6:08 min), PI protocol (10:57 min), and STD protocol (13:28 min). Overall image quality and visibility of TMJ relevant structures were qualitatively evaluated by a 4-point Likert scale. Quantitative analysis of signal-to-noise ratio (SNR) and contrast-to-noise ratio (CNR) of TMJ disc, condyle, and lateral pterygoid muscle (LPM) was performed. Diagnostic agreement of joint effusion and disc displacement among protocols and investigators was assessed by Fleiss' kappa analysis. A total of 51 participants (16 male and 35 female) with 102 TMJs were included. The overall image quality and most structures of the ACS protocol were significantly higher than the STD protocol (all p < 0.05), and similar to the PI protocol. For quantitative analysis, the ACS protocol demonstrated significantly higher SNR and CNR than the STD protocol in the TMJ disc, condyle, and LPM (all p < 0.05), and the ACS protocol showed comparable SNR to the PI protocol in most sequences. Good to excellent inter-protocol and inter-observer agreement was observed for diagnosing TMJ abnormalities (κ = 0.699-1.000). Accelerated MRI with ACS technique can significantly reduce the acquisition time of TMJ, while providing superior or equivalent image quality and great diagnostic agreement with PI and STD protocols. Question Patients with TMJ disorders often cannot endure long MRI examinations due to orofacial pain, necessitating accelerated MRI to improve patient comfort. Findings ACS technique can significantly reduce acquisition time in TMJ imaging while providing superior or equivalent image quality. Clinical relevance The time-saving ACS technique improves image quality and achieves excellent diagnostic agreement in the evaluation of joint effusion and disc displacement. It helps optimize clinical MRI workflow in patients with TMJ disorders.

Delayed neurological sequelae are among the most serious complications of carbon monoxide poisoning. However, no reliable tools are available for evaluating its potential risk. We aimed to assess whether machine learning models using imaging features that were automatically extracted from brain MRI can predict the potential delayed neurological sequelae risk in patients with acute carbon monoxide poisoning. This single-center, retrospective, observational study analyzed a prospectively collected registry of acute carbon monoxide poisoning patients who visited our emergency department from April 2011 to December 2015. Overall, 1618 radiomics and 4 lesion-segmentation features from DWI b1000 and ADC images, as well as 62 clinical variables were extracted from each patient. The entire dataset was divided into five subsets, with one serving as the hold-out test set and the remaining four used for training and tuning. Four machine learning models, linear regression, support vector machine, random forest, and extreme gradient boosting, as well as an ensemble model, were trained and evaluated using 20 different data configurations. The primary evaluation metric was the mean and 95% CI of the area under the receiver operating characteristic curve. Shapley additive explanations were calculated and visualized to enhance model interpretability. Of the 373 patients, delayed neurological sequelae occurred in 99 (26.5%) patients (mean age 43.0 ± 15.2; 62.0% male). The means [95% CIs] of the area under the receiver operating characteristic curve, accuracy, sensitivity, and specificity of the best performing machine learning model for predicting the development of delayed neurological sequelae were 0.88 [0.86-0.9], 0.82 [0.8-0.83], 0.81 [0.79-0.83], and 0.82 [0.8-0.84], respectively. Among imaging features, the presence, size, and number of acute brain lesions on DWI b1000 and ADC images more accurately predicted DNS risk than advanced radiomics features based on shape, texture and wavelet transformation. Machine learning models developed using automatically extracted brain MRI features with clinical features can distinguish patients at delayed neurological sequelae risk. The models enable effective prediction of delayed neurological sequelae in patients with acute carbon monoxide poisoning, facilitating timely treatment planning for prevention. ABL = Acute brain lesion; AUROC = area under the receiver operating characteristic curve; CO = carbon monoxide; DNS = delayed neurological sequelae; LR = logistic regression; ML = machine learning; RF = random forest; SVM = support vector machine; XGBoost = extreme gradient boosting.

Prognosis for thoracic aortic aneurysms is significantly worse for women than men, with a higher mortality rate observed among female patients. The increasing use of magnetic resonance breast imaging (MRI) offers a unique opportunity for simultaneous detection of both breast cancer and thoracic aortic aneurysms. We retrospectively validate a fully-automated artificial neural network (ANN) pipeline on 5057 breast MRI examinations from public (Duke University Hospital/EA1141 trial) and in-house (Erlangen University Hospital) data. The ANN, benchmarked against 3D-ground-truth segmentations, clinical reports, and a multireader panel, demonstrates high technical robustness (dice/clDice 0.88-0.91/0.97-0.99) across different vendors and field strengths. The ANN improves aneurysm detection rates by 3.5-fold compared with routine clinical readings, highlighting its potential to improve early diagnosis and patient outcomes. Notably, a higher odds ratio (OR = 2.29, CI: [0.55,9.61]) for thoracic aortic aneurysms is observed in women with breast cancer or breast cancer history, suggesting potential further benefits from integrated simultaneous assessment for cancer and aortic aneurysms.