摘要
Brain tumor segmentation (BTS) in magnetic resonance image (MRI) is crucial for brain tumor diagnosis, cancer management and research purposes. With the great success of the ten-year BraTS challenges as well as the advances of CNN and Transformer algorithms, a lot of outstanding BTS models have been proposed to tackle the difficulties of BTS in different technical aspects. However, existing studies hardly consider how to fuse the multi-modality images in a reasonable manner. In this paper, we leverage the clinical knowledge of how radiologists diagnose brain tumors from multiple MRI modalities and propose a clinical knowledge-driven brain tumor segmentation model, called CKD-TransBTS. Instead of directly concatenating all the modalities, we re-organize the input modalities by separating them into two groups according to the imaging principle of MRI. A dual-branch hybrid encoder with the proposed modality-correlated cross-attention block (MCCA) is designed to extract the multi-modality image features. The proposed model inherits the strengths from both Transformer and CNN with the local feature representation ability for precise lesion boundaries and long-range feature extraction for 3D volumetric images. To bridge the gap between Transformer and CNN features, we propose a Trans & CNN Feature Calibration block (TCFC) in the decoder. We compare the proposed model with six CNN-based models and six transformer-based models on the BraTS 2021 challenge dataset. Extensive experiments demonstrate that the proposed model achieves state-of-the-art brain tumor segmentation performance compared with all the competitors.
学科与关键词
- TransConver: transformer and convolution parallel network for developing automatic brain tumor segmentation in MRI imagesLiang, Junjie; Yang, Cihui*; Zeng, Mengjie; Wang, XixiQUANTITATIVE IMAGING IN MEDICINE AND SURGERY, 2022, 12(4): 2397-2415.被引 19
- 3D PSwinBTS: An efficient transformer-based Unet using 3D parallel shifted windows for brain tumor segmentationLiang, Junjie; Yang, Cihui*; Zeng, LingguoDigital Signal Processing: A Review Journal , 2022, 131: 103784.被引 7
- Axial Attention Convolutional Neural Network for Brain Tumor Segmentation with Multi-Modality MRI ScansTian, Weiwei; Li, Dengwang*; Lv, Mengyu; Huang, PuBrain Sciences, 2023, 13(1): 12.被引 1
