ScholarMate
English简体中文繁體中文
客服热线:400-1616-289
登录注册
期刊论文

MISSU: 3D Medical Image Segmentation via Self-Distilling TransUNet

Wang, Nan; Lin, Shaohui*; Li, Xiaoxiao; Li, Ke; Shen, Yunhang; Gao, Yue; Ma, Lizhuang*清华大学; 6; 1
IEEE Transactions on Medical Imaging2023-9DOI: 10.1109/TMI.2023.3264433
5被引5阅读
引用收藏
分享

摘要

U-Nets have achieved tremendous success in medical image segmentation. Nevertheless, it may have limitations in global (long-range) contextual interactions and edge-detail preservation. In contrast, the Transformer module has an excellent ability to capture long-range dependencies by leveraging the self-attention mechanism into the encoder. Although the Transformer module was born to model the long-range dependency on the extracted feature maps, it still suffers high computational and spatial complexities in processing high-resolution 3D feature maps. This motivates us to design an efficient Transformer-based UNet model and study the feasibility of Transformer-based network architectures for medical image segmentation tasks. To this end, we propose to self-distill a Transformer-based UNet for medical image segmentation, which simultaneously learns global semantic information and local spatial-detailed features. Meanwhile, a local multi-scale fusion block is first proposed to refine fine-grained details from the skipped connections in the encoder by the main CNN stem through self-distillation, only computed during training and removed at inference with minimal overhead. Extensive experiments on BraTS 2019 and CHAOS datasets show that our MISSU achieves the best performance over previous state-of-the-art methods. Code and models are available at: https://github.com/wangn123/MISSU.git

学科与关键词

关键词
Image segmentationTransformersThree-dimensional displaysSemanticsFeature extractionComputational modelingTrainingSelf-distillationtransformermedical image segmentation3D convolutional neural networks
相关
加载中…
  • BTSwin-Unet: 3D U-shaped Symmetrical Swin Transformer-based Network for Brain Tumor Segmentation with Self-supervised Pre-training
    Liang, Junjie; Yang, Cihui*; Zhong, Jingting; Ye, XiaoliNEURAL PROCESSING LETTERS, 2023, 55(4): 3695-3713.被引 11
  • 3D PSwinBTS: An efficient transformer-based Unet using 3D parallel shifted windows for brain tumor segmentation
    Liang, Junjie; Yang, Cihui*; Zeng, LingguoDigital Signal Processing: A Review Journal , 2022, 131: 103784.被引 7
  • MSAANet: Multi-scale Axial Attention Network for medical image segmentation
    Zeng, Hao; Shan, Xinxin; Feng, Yu; Wen, Ying*IEEE International Conference on Multimedia and Expo (ICME), Brisbane, AUSTRALIA, 2023-07-10 To 2023-07-14.
查看全部 →

发表信息

论文状态
公开发表
期刊
IEEE Transactions on Medical Imaging
发表日期
2023-09
卷期
第 42 卷, 第 9 期
页码
2740-2750
DOI
10.1109/TMI.2023.3264433
语言
ENGLISH
成果收录
SCIE
资助标注
National Natural Science Foundation of China [61972157, 72192821, 62102151]; Shanghai Sailing Program [21YF1411200]; Shanghai Municipal Science and Technology Major Project [2021SHZDZX0102]; Shanghai Science and Technology Commission [22511104600, 21511101200]; CAAI-Huawei MindSpore Open Fund [CAAIXSJLJJ-2021-031A]

作者

  • W

    Wang, Nan (第一作者)

  • L

    Lin, Shaohui (通讯)

查看全部 7 位作者收起作者
  • L

    Li, Xiaoxiao

    1 · 6

  • L

    Li, Ke

    tencent

  • S

    Shen, Yunhang

    tencent

  • G

    Gao, Yue

    tsinghua univ

  • M

    Ma, Lizhuang (通讯)

登录解锁更多功能

  • 收藏这篇,随时在“我的 · 收藏”找回
  • 认领你的成果,生成推广素材
  • 关注作者获取最新成果
  • 加入项目组、协同写作
注册 / 登录

产品服务

  • 科研之友
  • 创新城
  • 科创云

服务支持

  • 帮助中心
  • 隐私政策
  • 服务条款

联系方式

在线客服:【】
客服热线:400-1616-289
电子邮箱:support@scholarmate.com

关注或下载科研之友

微信二维码
微信公众号
客户端下载二维码
下载客户端
科研成果科研人员科研机构科研动态爱瑞思软件

©2026 深圳市科研之友网络服务有限公司

公安备案图标粤公网安备 44030502000213
粤ICP备 16046710 号粤B2-20110417