ScholarMate
English简体中文繁體中文
客服热线:400-1616-289
登录注册
期刊论文

FAFuse: A Four-Axis Fusion framework of CNN and Transformer for medical image segmentation

Xu, Shoukun; Xiao, Dehao; Yuan, Baohua*; Liu, Yi; Wang, Xueyuan; Li, Ning; Shi, Lin; Chen, Jialu; Zhang, Ju-Xiao; Wang, Yanhao; Cao, Jianfeng; Shao, Yeqin; Jiang, Mingjie南通大学; 常州大学
Computers in Biology and Medicine2023-11DOI: 10.1016/j.compbiomed.2023.107567
4阅读
引用收藏
分享

摘要

Medical image segmentation is crucial for accurate diagnosis and treatment in the medical field. In recent years, convolutional neural networks (CNNs) and Transformers have been frequently adopted as network architectures in medical image segmentation. The convolution operation is limited in modeling long-range dependencies because it can only extract local information through the limited receptive field. In comparison, Transformers demonstrate excellent capability in modeling long-range dependencies but are less effective in capturing local information. Hence, effectively modeling long-range dependencies while preserving local information is essential for accurate medical image segmentation. In this paper, we propose a four-axis fusion framework called FAFuse, which can exploit the advantages of CNN and Transformer. As the core component of our FAFuse, a Four-Axis Fusion module (FAF) is proposed to efficiently fuse global and local information. FAF combines Four-Axis attention (height, width, main diagonal, and counter diagonal axial attention), a multi-scale convolution, and a residual structure with a depth-separable convolution and a Hadamard product. Furthermore, we also introduce deep supervision to enhance gradient flow and improve overall performance. Our approach achieves state-of-the-art segmentation accuracy on three publicly available medical image segmentation datasets. The code is available at https://github.com/cczu-xiao/FAFuse.

学科与关键词

关键词
Medical image segmentationCNNTransformerFour-Axis attentionFeature fusion
相关
加载中…
  • MSAANet: Multi-scale Axial Attention Network for medical image segmentation
    Zeng, Hao; Shan, Xinxin; Feng, Yu; Wen, Ying*IEEE International Conference on Multimedia and Expo (ICME), Brisbane, AUSTRALIA, 2023-07-10 To 2023-07-14.
  • Transformer-Based End-to-End Anatomical and Functional Image Fusion
    Zhang, Jing; Liu, Aiping*; Wang, Dan; Liu, Yu; Wang, Z. Jane; Chen, Xun*IEEE Transactions on Instrumentation and Measurement, 2022, 71: 5019711.被引 1
  • Transforming medical imaging with Transformers? A comparative review of key properties, current progresses, and future perspectives
    Li, Jun; Chen, Junyu; Tang, Yucheng; Wang, Ce; Landman, Bennett A.; Zhou, S. Kevin*Medical Image Analysis, 2023, 85: 102762.被引 110
查看全部 →

发表信息

论文状态
公开发表
期刊
Computers in Biology and Medicine
发表日期
2023-11
卷期
第 166 卷
页码
107567
DOI
10.1016/j.compbiomed.2023.107567
语言
ENGLISH
成果收录
SCIE
资助标注
Jiangsu Engineering Research Center of Digital Twinning Technology for Key Equipment in Petro-chemical Process [DTEC202003, DTEC202102]

作者

  • X

    Xu, Shoukun (第一作者)

    changzhou univ

  • X

    Xiao, Dehao

    changzhou univ

查看全部 13 位作者收起作者
  • Y

    Yuan, Baohua (通讯)

    changzhou univ

  • L

    Liu, Yi

    changzhou univ

  • W

    Wang, Xueyuan

    changzhou univ

  • L

    Li, Ning

    changzhou univ

  • S

    Shi, Lin

    changzhou univ

  • C

    Chen, Jialu

    changzhou univ

  • Z

    Zhang, Ju-Xiao

    nanjing normal univ

  • W

    Wang, Yanhao

    new

  • C

    Cao, Jianfeng

    chinese univ hong kong

  • S

    Shao, Yeqin

    nantong univ

  • J

    Jiang, Mingjie

登录解锁更多功能

  • 收藏这篇,随时在“我的 · 收藏”找回
  • 认领你的成果,生成推广素材
  • 关注作者获取最新成果
  • 加入项目组、协同写作
注册 / 登录

产品服务

  • 科研之友
  • 创新城
  • 科创云

服务支持

  • 帮助中心
  • 隐私政策
  • 服务条款

联系方式

在线客服:【】
客服热线:400-1616-289
电子邮箱:support@scholarmate.com

关注或下载科研之友

微信二维码
微信公众号
客户端下载二维码
下载客户端
科研成果科研人员科研机构科研动态爱瑞思软件

©2026 深圳市科研之友网络服务有限公司

公安备案图标粤公网安备 44030502000213
粤ICP备 16046710 号粤B2-20110417