ScholarMate
English简体中文繁體中文
客服热线:400-1616-289
登录注册
期刊论文

CKD-TransBTS: Clinical Knowledge-Driven Hybrid Transformer With Modality-Correlated Cross-Attention for Brain Tumor Segmentation

Lin, Jianwei; Lin, Jiatai; Lu, Cheng; Chen, Hao; Lin, Huan; Zhao, Bingchao; Shi, Zhenwei; Qiu, Bingjiang; Pan, Xipeng; Xu, Zeyan; Huang, Biao; Liang, Changhong; Han, Guoqiang*; Liu, Zaiyi*; Han, Chu*广东省人民医院; 南方医科大学
IEEE Transactions on Medical Imaging2023-8DOI: 10.1109/TMI.2023.3250474
7被引27阅读
引用收藏
分享

摘要

Brain tumor segmentation (BTS) in magnetic resonance image (MRI) is crucial for brain tumor diagnosis, cancer management and research purposes. With the great success of the ten-year BraTS challenges as well as the advances of CNN and Transformer algorithms, a lot of outstanding BTS models have been proposed to tackle the difficulties of BTS in different technical aspects. However, existing studies hardly consider how to fuse the multi-modality images in a reasonable manner. In this paper, we leverage the clinical knowledge of how radiologists diagnose brain tumors from multiple MRI modalities and propose a clinical knowledge-driven brain tumor segmentation model, called CKD-TransBTS. Instead of directly concatenating all the modalities, we re-organize the input modalities by separating them into two groups according to the imaging principle of MRI. A dual-branch hybrid encoder with the proposed modality-correlated cross-attention block (MCCA) is designed to extract the multi-modality image features. The proposed model inherits the strengths from both Transformer and CNN with the local feature representation ability for precise lesion boundaries and long-range feature extraction for 3D volumetric images. To bridge the gap between Transformer and CNN features, we propose a Trans & CNN Feature Calibration block (TCFC) in the decoder. We compare the proposed model with six CNN-based models and six transformer-based models on the BraTS 2021 challenge dataset. Extensive experiments demonstrate that the proposed model achieves state-of-the-art brain tumor segmentation performance compared with all the competitors.

学科与关键词

关键词
Clinical knowledge-drivenbrain tumor segmentationtransformermulti-modal fusion
相关
加载中…
  • TransConver: transformer and convolution parallel network for developing automatic brain tumor segmentation in MRI images
    Liang, Junjie; Yang, Cihui*; Zeng, Mengjie; Wang, XixiQUANTITATIVE IMAGING IN MEDICINE AND SURGERY, 2022, 12(4): 2397-2415.被引 19
  • 3D PSwinBTS: An efficient transformer-based Unet using 3D parallel shifted windows for brain tumor segmentation
    Liang, Junjie; Yang, Cihui*; Zeng, LingguoDigital Signal Processing: A Review Journal , 2022, 131: 103784.被引 7
  • Axial Attention Convolutional Neural Network for Brain Tumor Segmentation with Multi-Modality MRI Scans
    Tian, Weiwei; Li, Dengwang*; Lv, Mengyu; Huang, PuBrain Sciences, 2023, 13(1): 12.被引 1
查看全部 →

发表信息

论文状态
公开发表
期刊
IEEE Transactions on Medical Imaging
发表日期
2023-08
卷期
第 42 卷, 第 8 期
页码
2451-2461
DOI
10.1109/TMI.2023.3250474
语言
ENGLISH
成果收录
SCIE
资助标注
Key-Area Research and Development Program of Guangdong Province [2021B0101420006]; Guangdong Provincial Key Laboratory of Artificial Intelligence in Medical Image Analysis and Application [2022B1212010011]; National Key Research and Development Program of China [2021YFF1201003]; National Science Fund for Distinguished Young Scholars [81925023]; National Natural Science Foundation of China [U22A20345, 62102103, 62002082, 82202142, DFJHBF202105]; National Science Foundation for Young Scientists of China [82272084, 82271941, 82071892, 82071871]; High-Level Hospital Construction Project [2021M690753]; China Postdoctoral Science Foundation [2022M710843]; [82102034]

作者

  • L

    Lin, Jianwei (第一作者)

  • L

    Lin, Jiatai

查看全部 15 位作者收起作者
  • L

    Lu, Cheng

    guangdong prov peoples hosp · southern med univ

  • C

    Chen, Hao

    hong kong univ sci & technol

  • L

    Lin, Huan

    guangdong prov peoples hosp · southern med univ

  • Z

    Zhao, Bingchao

    guangdong prov peoples hosp · southern med univ

  • S

    Shi, Zhenwei

    guangdong prov peoples hosp · southern med univ

  • Q

    Qiu, Bingjiang

    guangdong prov peoples hosp · southern med univ

  • P

    Pan, Xipeng

    guangdong prov peoples hosp · southern med univ

  • X

    Xu, Zeyan

    guangdong prov peoples hosp · southern med univ

  • H

    Huang, Biao

    guangdong prov peoples hosp · southern med univ

  • L

    Liang, Changhong

    guangdong prov peoples hosp · southern med univ

  • H

    Han, Guoqiang (通讯)

  • L

    Liu, Zaiyi (通讯)

    guangdong prov peoples hosp · southern med univ

  • H

    Han, Chu (通讯)

    guangdong prov peoples hosp · southern med univ

登录解锁更多功能

  • 收藏这篇,随时在“我的 · 收藏”找回
  • 认领你的成果,生成推广素材
  • 关注作者获取最新成果
  • 加入项目组、协同写作
注册 / 登录

产品服务

  • 科研之友
  • 创新城
  • 科创云

服务支持

  • 帮助中心
  • 隐私政策
  • 服务条款

联系方式

在线客服:【】
客服热线:400-1616-289
电子邮箱:support@scholarmate.com

关注或下载科研之友

微信二维码
微信公众号
客户端下载二维码
下载客户端
科研成果科研人员科研机构科研动态爱瑞思软件

©2026 深圳市科研之友网络服务有限公司

公安备案图标粤公网安备 44030502000213
粤ICP备 16046710 号粤B2-20110417