FBFormer: interventional ultra-sparse CT reconstruction with image prior using feature back-projection and transformer.
Authors
Affiliations (5)
Affiliations (5)
- Shanghai Jiao Tong University School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, Shanghai, 200040, CHINA.
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai 200240, Shanghai, 200240, CHINA.
- CT Department, Shanghai United Imaging Healthcare Co Ltd, Shanghai 201815, Shanghai, 201815, CHINA.
- Shanghai Jiao Tong University, Shanghai 200240, Shanghai, 200240, CHINA.
- Department of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai 200240, Shanghai, Shanghai, 200240, CHINA.
Abstract
CT-guided interventional procedures hold a significant position in clinical practice. However, due to the high number of scans and prolonged procedure times, patients are exposed to considerable radiation doses. This study aims to utilize intraoperative X-ray imaging as an alternative to intraoperative CT guidance, integrating preoperative prior scan images to reconstruct interventional CT.
Approach: We present FBFormer, a reconstruction framework using Transformer and a novel feature back-projection module to reconstruct tomographic data from ultra-sparse(less than 10 views) intraoperative X-ray images. A mixed UNet and PVT encoder is employed to extract the local and global feature of the X-ray images and preoperative image prior, supporting more various input, while a feature backprojection module is utilized to achieve 2D-3D conversion in a more natural and geometrically consistent manner.
Main Results: Extensive experiments on our simulated 4DCT and clinical validation datasets demonstrate the effectiveness of the proposed method and our method achieves superior results in reconstruction performance metrics and outperforms other compelling methods.
Significance: The proposed method has the potential to significantly reduce radiation exposure during interventional procedures while maintaining high-quality reconstruction. The proposed FBFormer framework demonstrates the potential to enhance the clinical reliability of interventional CT reconstruction from ultra-sparse X-ray projections by the integration of image priors and the geometric preserving feature back-projection module.