ScholarMate
English简体中文繁體中文
客服热线:400-1616-289
登录注册
期刊论文

Brain tumor segmentation in multimodal MRI via pixel-level and feature-level image fusion

Liu, Yu; Mu, Fuhao; Shi, Yu; Cheng, Juan; Li, Chang; Chen, Xun*univ sci & technol china
Frontiers in Neuroscience2022-9-14DOI: 10.3389/fnins.2022.1000587
9被引5阅读
引用收藏
分享

摘要

Brain tumor segmentation in multimodal MRI volumes is of great significance to disease diagnosis, treatment planning, survival prediction and other relevant tasks. However, most existing brain tumor segmentation methods fail to make sufficient use of multimodal information. The most common way is to simply stack the original multimodal images or their low-level features as the model input, and many methods treat each modality data with equal importance to a given segmentation target. In this paper, we introduce multimodal image fusion technique including both pixel-level fusion and feature-level fusion for brain tumor segmentation, aiming to achieve more sufficient and finer utilization of multimodal information. At the pixel level, we present a convolutional network named PIF-Net for 3D MR image fusion to enrich the input modalities of the segmentation model. The fused modalities can strengthen the association among different types of pathological information captured by multiple source modalities, leading to a modality enhancement effect. At the feature level, we design an attention-based modality selection feature fusion (MSFF) module for multimodal feature refinement to address the difference among multiple modalities for a given segmentation target. A two-stage brain tumor segmentation framework is accordingly proposed based on the above components and the popular V-Net model. Experiments are conducted on the BraTS 2019 and BraTS 2020 benchmarks. The results demonstrate that the proposed components on both pixel-level and feature-level fusion can effectively improve the segmentation accuracy of brain tumors.

学科与关键词

关键词
brain tumor segmentationmedical image fusionpixel-level fusionfeature-level fusionconvolutional neural networks
相关
加载中…
  • Multimodal MRI Volumetric Data Fusion With Convolutional Neural Networks
    Liu, Yu; Shi, Yu; Mu, Fuhao; Cheng, Juan; Li, Chang; Chen, Xun*IEEE Transactions on Instrumentation and Measurement, 2022, 71: 4006015.被引 16
  • Brain tumor segmentation based on the fusion of deep semantics and edge information in multimodal MRI
    Zhu, Zhiqin; He, Xianyu; Qi, Guanqiu; Li, Yuanyuan; Cong, Baisen; Liu, Yu*Information Fusion, 2023, 91: 376-387.被引 111
  • SF-Net: A Multi-Task Model for Brain Tumor Segmentation in Multimodal MRI via Image Fusion
    Liu, Yu; Mu, Fuhao; Shi, Yu; Chen, Xun*IEEE SIGNAL PROCESSING LETTERS, 2022, 29: 1799-1803.被引 15
查看全部 →

发表信息

论文状态
公开发表
期刊
Frontiers in Neuroscience
发表日期
2022-09-14
卷期
第 16 卷
页码
1000587
DOI
10.3389/fnins.2022.1000587
语言
ENGLISH
期刊等级
3区
成果收录
SCIE
资助标注
National Natural Science Foundation of China; Fundamental Research Funds for the Central Universities; [62176081]; [61922075]; [62171176]; [41901350]; [JZ2020HGPA0111]; [JZ2021HGPA0061]

作者

  • L

    Liu, Yu (第一作者)

  • M

    Mu, Fuhao

查看全部 6 位作者收起作者
  • S

    Shi, Yu

  • C

    Cheng, Juan

  • L

    Li, Chang

  • C

    Chen, Xun (通讯)

    univ sci & technol china

登录解锁更多功能

  • 收藏这篇,随时在“我的 · 收藏”找回
  • 认领你的成果,生成推广素材
  • 关注作者获取最新成果
  • 加入项目组、协同写作
注册 / 登录

产品服务

  • 科研之友
  • 创新城
  • 科创云

服务支持

  • 帮助中心
  • 隐私政策
  • 服务条款

联系方式

在线客服:【】
客服热线:400-1616-289
电子邮箱:support@scholarmate.com

关注或下载科研之友

微信二维码
微信公众号
客户端下载二维码
下载客户端
科研成果科研人员科研机构科研动态爱瑞思软件

©2026 深圳市科研之友网络服务有限公司

公安备案图标粤公网安备 44030502000213
粤ICP备 16046710 号粤B2-20110417