ViT-GCN: A Novel Hybrid Model for Accurate Pneumonia Diagnosis from X-ray Images.

Authors

Xu N,Wu J,Cai F,Li X,Xie HB

Affiliations (5)

  • Wenzhou University, oujiang, Wenzhou, Zhejiang, 325035, CHINA.
  • The University of Queensland, Brisbane, Brisbane, Queensland, 4067, AUSTRALIA.
  • Wenzhou University, Oujiang, Wenzhou, Zhejiang, 325035, CHINA.
  • Ceyear Technologies Co Ltd, Qingdao, Qingdao, Shandong, 266555, CHINA.
  • Queensland University of Technology, Bribane, Brisbane, Queensland, 4001, AUSTRALIA.

Abstract

This study aims to enhance the accuracy of pneumonia diagnosis from X-ray images by developing a model that integrates Vision Transformer (ViT) and Graph Convolutional Networks (GCN) for improved feature extraction and diagnostic performance. The ViT-GCN model was designed to leverage the strengths of both ViT, which captures global image information by dividing the image into fixed-size patches and processing them in sequence, and GCN, which captures node features and relationships through message passing and aggregation in graph data. A composite loss function combining multivariate cross-entropy, focal loss, and GHM loss was introduced to address dataset imbalance and improve training efficiency on small datasets. The ViT-GCN model demonstrated superior performance, achieving an accuracy of 91.43\% on the COVID-19 chest X-ray database, surpassing existing models in diagnostic accuracy for pneumonia. The study highlights the effectiveness of combining ViT and GCN architectures in medical image diagnosis, particularly in addressing challenges related to small datasets. This approach can lead to more accurate and efficient pneumonia diagnoses, especially in resource-constrained settings where small datasets are common.

Topics

Journal Article

Ready to Sharpen Your Edge?

Join hundreds of your peers who rely on RadAI Slice. Get the essential weekly briefing that empowers you to navigate the future of radiology.

We respect your privacy. Unsubscribe at any time.