Dual-representation structural MRI classification of psychiatric disorders using deep learning and large language models.
Authors
Affiliations (2)
Affiliations (2)
- Bursa Uludag University, Faculty of Engineering, Department of Electrical and Electronics Engineering, Bursa, Turkey. Electronic address: [email protected].
- Academy Professor, Departments of Biomedical Informatics and Neuroscience, The Ohio State University, Columbus, OH, USA. Electronic address: [email protected].
Abstract
Accurate differentiation among psychiatric disorders such as schizophrenia and bipolar disorder remains a significant clinical challenge due to overlapping symptoms and subtle neuroanatomical variations. This study proposes a dual-representation structural MRI framework in which raw T1-weighted MRI slices and their corresponding color-coded tissue segmentation maps-both derived from the same imaging modality-are analyzed using two independently trained ResNet-18 CNNs. The four diagnostic groups examined include Healthy Controls, Schizophrenia Spectrum, Bipolar Disorder with Psychosis, and Bipolar Disorder without Psychosis. TL and DA techniques were employed to address the limited dataset (N= 103). Following model training, a Large Language Model (LLM) was used as a post-hoc analysis tool to contextualize the CNN outputs and provide interpretative insights into the relative contributions of the two MRI-derived representations. The results indicate that the dual-representation approach improves four-way classification performance and enables systematic comparison of structural information captured by raw versus segmentation-based inputs. These findings highlight the potential of combining deep learning models with LLM-assisted interpretability to support more transparent and informative diagnostic tools in psychiatric neuroimaging.