摘要
Recently, vision transformers have become outstanding segmentation structures for their remarkable global modeling capability. In current transformer-based models for medical image segmentation, convolutional layers are often replaced by transformers, or transformers are added to the deepest layer of the encoder to learn the global context. However, for the extracted multi-scale feature information, most existing methods tend to ignore the multi-scale dependencies, which leads to inadequate feature learning and fails to produce rich feature representations. In this paper, we propose ScaleNet from the perspective of feature interaction at different scales that can alleviate mentioned problems. Specifically, our approach consists of two multi-scale feature interaction modules: the spatial scale interaction (SSI) and the channel scale interaction (CSI). SSI uses a transformer to aggregate patches from different scale features to enhance the feature representations at the spatial scale. CSI uses a 1D convolutional layer and a fully connected layer to perform a global fusion of multi-level features at the channel scale. The combination of CSI and SSI enables ScaleNet to emphasize multi-scale dependencies and effectively resolve complex scale variations.
学科与关键词
- MSAANet: Multi-scale Axial Attention Network for medical image segmentationZeng, Hao; Shan, Xinxin; Feng, Yu; Wen, Ying*IEEE International Conference on Multimedia and Expo (ICME), Brisbane, AUSTRALIA, 2023-07-10 To 2023-07-14.
- MSINET: Multi-scale Interconnection Network for Medical Image SegmentationXu, Zhengke; Shan, Xinxin; Wen, Ying*40th Computer Graphics International Conference (CGI), Shanghai, PEOPLES R CHINA, 2023-08-28 To 2023.
- LTUNet: A Lightweight Transformer-Based UNet with Multi-scale Mechanism for Skin Lesion SegmentationGuo, Huike; Zhang, Han; Li, Minghe; Quan, Xiongwen*3rd CAAI International Conference on Artificial Intelligence (CICAI), Chinese Assoc Artificial Intelligence, Fuzhou, PEOPLES R CHINA, 2023-07-22 To 2023-07-23.
