摘要
Remote sensing scene classification remains challenging due to the complexity and variety of scenes. With the development of attention-based methods, Convolutional Neural Networks (CNNs) have achieved competitive performance in remote sensing scene classification tasks. As an important method of the attention-based model, the Transformer has achieved great success in the field of natural language processing. Recently, the Transformer has been used for computer vision tasks. However, most existing methods divide the original image into multiple patches and encode the patches as the input of the Transformer, which limits the model's ability to learn the overall features of the image. In this paper, we propose a new remote sensing scene classification method, Remote Sensing Transformer (TRS), a powerful "pure CNNs -> Convolution + Transformer -> pure Transformers " structure. First, we integrate self-attention into ResNet in a novel way, using our proposed Multi-Head Self-Attention layer instead of 3 x 3 spatial revolutions in the bottleneck. Then we connect multiple pure Transformer encoders to further improve the representation learning performance completely depending on attention. Finally, we use a linear classifier for classification. We train our model on four public remote sensing scene datasets: UC-Merced, AID, NWPU-RESISC45, and OPTIMAL-31. The experimental results show that TRS exceeds the state-of-the-art methods and achieves higher accuracy.
学科与关键词
- Vision Transformers for Remote Sensing Image ClassificationBazi, Yakoub*; Bashmal, Laila; Rahhal, Mohamad M. Al; Dayil, Reham Al; Ajlan, Naif AlRemote Sensing, 2021, 13(3): 516.被引 307
- Homo-Heterogenous Transformer Learning Framework for RS Scene ClassificationMa, Jingjing; Li, Mingteng; Tang, Xu*; Zhang, Xiangrong; Liu, Fang; Jiao, LichengIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2022, 15: 2223-2239.被引 38
- FCIHMRT: Feature Cross-Layer Interaction Hybrid Method Based on Res2Net and Transformer for Remote Sensing Scene ClassificationHuo, Yan; Gang, Shuang; Guan, Chao*Electronics, 2023, 12(20): 4362.被引 45
