ScholarMate
English简体中文繁體中文
客服热线:400-1616-289
登录注册
期刊论文

Is Attention all You Need in Medical Image Analysis? A Review

Papanastasiou, Giorgos*; Dikaios, Nikolaos; Huang, Jiahao; Wang, Chengjia; Yang, Guang*
IEEE Journal of Biomedical and Health Informatics2024-3DOI: 10.1109/JBHI.2023.3348436
8被引16阅读
引用收藏
分享

摘要

Medical imaging is a key component in clinical diagnosis, treatment planning and clinical trial design, accounting for almost 90% of all healthcare data. CNNs achieved performance gains in medical image analysis (MIA) over the last years. CNNs can efficiently model local pixel interactions and be trained on small-scale MI data. Despite their important advances, typical CNN have relatively limited capabilities in modelling "global" pixel interactions, which restricts their generalisation ability to understand out-of-distribution data with different "global" information. The recent progress of Artificial Intelligence gave rise to Transformers, which can learn global relationships from data. However, full Transformer models need to be trained on large-scale data and involve tremendous computational complexity. Attention and Transformer compartments ("Transf/Attention") which can well maintain properties for modelling global relationships, have been proposed as lighter alternatives of full Transformers. Recently, there is an increasing trend to co-pollinate complementary local-global properties from CNN and Transf/Attention architectures, which led to a new era of hybrid models. The past years have witnessed substantial growth in hybrid CNN-Transf/Attention models across diverse MIA problems. In this systematic review, we survey existing hybrid CNN-Transf/Attention models, review and unravel key architectural designs, analyse breakthroughs, and evaluate current and future opportunities as well as challenges. We also introduced an analysis framework on generalisation opportunities of scientific and clinical impact, based on which new data-driven domain generalisation and adaptation methods can be stimulated.

学科与关键词

关键词
Attentioncomputed tomographyconvo- lutional neural networksmagnetic resonance imagingmedical image analysispositron emission tomographyretinal imagingtransformers
相关
加载中…
  • Recent progress in transformer-based medical image analysis
    Liu, Zhaoshan; Lv, Qiujie; Yang, Ziduo; Li, Yifan; Lee, Chau Hung; Shen, Lei*Computers in Biology and Medicine, 2023, 164: 107268.被引 28
  • Transforming medical imaging with Transformers? A comparative review of key properties, current progresses, and future perspectives
    Li, Jun; Chen, Junyu; Tang, Yucheng; Wang, Ce; Landman, Bennett A.; Zhou, S. Kevin*Medical Image Analysis, 2023, 85: 102762.被引 110
  • Transformers and large language models in healthcare: A review
    Nerella, Subhash; Bandyopadhyay, Sabyasachi; Zhang, Jiaqing; Contreras, Miguel; Siegel, Scott; Bumin, Aysegul; Silva, Brandon; Sena, Jessica; Shickel, Benjamin; Bihorac, Azra; Khezeli, Kia; Rashidi, Parisa*Artificial Intelligence in Medicine, 2024, 154: 102900.被引 4
查看全部 →

发表信息

论文状态
公开发表
期刊
IEEE Journal of Biomedical and Health Informatics
发表日期
2024-03
卷期
第 28 卷, 第 3 期
页码
1398-1411
DOI
10.1109/JBHI.2023.3348436
语言
ENGLISH
成果收录
SCIE
资助标注
MIS

作者

  • P

    Papanastasiou, Giorgos (通讯) (第一作者)

  • D

    Dikaios, Nikolaos

查看全部 5 位作者收起作者
  • H

    Huang, Jiahao

  • W

    Wang, Chengjia

  • Y

    Yang, Guang (通讯)

登录解锁更多功能

  • 收藏这篇,随时在“我的 · 收藏”找回
  • 认领你的成果,生成推广素材
  • 关注作者获取最新成果
  • 加入项目组、协同写作
注册 / 登录

产品服务

  • 科研之友
  • 创新城
  • 科创云

服务支持

  • 帮助中心
  • 隐私政策
  • 服务条款

联系方式

在线客服:【】
客服热线:400-1616-289
电子邮箱:support@scholarmate.com

关注或下载科研之友

微信二维码
微信公众号
客户端下载二维码
下载客户端
科研成果科研人员科研机构科研动态爱瑞思软件

©2026 深圳市科研之友网络服务有限公司

公安备案图标粤公网安备 44030502000213
粤ICP备 16046710 号粤B2-20110417