摘要
The transformer is primarily used in the field of natural language processing. Recently, it has been adopted and shows promise in the computer vision (CV) field. Medical image analysis (MIA), as a critical branch of CV, also greatly benefits from this state-of-the-art technique. In this review, we first recap the core component of the transformer, the attention mechanism, and the detailed structures of the transformer. After that, we depict the recent progress of the transformer in the field of MIA. We organize the applications in a sequence of different tasks, including classification, segmentation, captioning, registration, detection, enhancement, localization, and synthesis. The mainstream classification and segmentation tasks are further divided into eleven medical image modalities. A large number of experiments studied in this review illustrate that the transformer-based method outperforms existing methods through comparisons with multiple evaluation metrics. Finally, we discuss the open challenges and future opportunities in this field. This task-modality review with the latest contents, detailed information, and comprehensive comparison may greatly benefit the broad MIA community.
学科与关键词
- Transforming medical imaging with Transformers? A comparative review of key properties, current progresses, and future perspectivesLi, Jun; Chen, Junyu; Tang, Yucheng; Wang, Ce; Landman, Bennett A.; Zhou, S. Kevin*Medical Image Analysis, 2023, 85: 102762.被引 110
- Is Attention all You Need in Medical Image Analysis? A ReviewPapanastasiou, Giorgos*; Dikaios, Nikolaos; Huang, Jiahao; Wang, Chengjia; Yang, Guang*IEEE Journal of Biomedical and Health Informatics, 2024, 28(3): 1398-1411.被引 8
- Advantages of transformer and its application for medical image segmentation: a surveyPu, Qiumei; Xi, Zuoxin; Yin, Shuai; Zhao, Zhe; Zhao, Lina*Biomedical Engineering Online, 2024, 23(1): 14.被引 9
