ScholarMate
English简体中文繁體中文
客服热线:400-1616-289
登录注册
期刊论文

TRS: Transformers for Remote Sensing Scene Classification

Zhang, Jianrong; Zhao, Hongwei; Li, Jiao*吉林大学
Remote Sensing2021-10DOI: 10.3390/rs13204143
78被引9阅读
引用收藏
分享

摘要

Remote sensing scene classification remains challenging due to the complexity and variety of scenes. With the development of attention-based methods, Convolutional Neural Networks (CNNs) have achieved competitive performance in remote sensing scene classification tasks. As an important method of the attention-based model, the Transformer has achieved great success in the field of natural language processing. Recently, the Transformer has been used for computer vision tasks. However, most existing methods divide the original image into multiple patches and encode the patches as the input of the Transformer, which limits the model's ability to learn the overall features of the image. In this paper, we propose a new remote sensing scene classification method, Remote Sensing Transformer (TRS), a powerful "pure CNNs -> Convolution + Transformer -> pure Transformers " structure. First, we integrate self-attention into ResNet in a novel way, using our proposed Multi-Head Self-Attention layer instead of 3 x 3 spatial revolutions in the bottleneck. Then we connect multiple pure Transformer encoders to further improve the representation learning performance completely depending on attention. Finally, we use a linear classifier for classification. We train our model on four public remote sensing scene datasets: UC-Merced, AID, NWPU-RESISC45, and OPTIMAL-31. The experimental results show that TRS exceeds the state-of-the-art methods and achieves higher accuracy.

学科与关键词

关键词
transformersdeep convolutional neural networksmulti-head self-attentionremote sensing scene classification
相关
加载中…
  • Vision Transformers for Remote Sensing Image Classification
    Bazi, Yakoub*; Bashmal, Laila; Rahhal, Mohamad M. Al; Dayil, Reham Al; Ajlan, Naif AlRemote Sensing, 2021, 13(3): 516.被引 307
  • Homo-Heterogenous Transformer Learning Framework for RS Scene Classification
    Ma, Jingjing; Li, Mingteng; Tang, Xu*; Zhang, Xiangrong; Liu, Fang; Jiao, LichengIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2022, 15: 2223-2239.被引 38
  • FCIHMRT: Feature Cross-Layer Interaction Hybrid Method Based on Res2Net and Transformer for Remote Sensing Scene Classification
    Huo, Yan; Gang, Shuang; Guan, Chao*Electronics, 2023, 12(20): 4362.被引 45
查看全部 →

发表信息

论文状态
公开发表
期刊
Remote Sensing
发表日期
2021-10
卷期
第 13 卷, 第 20 期
页码
4143
DOI
10.3390/rs13204143
语言
ENGLISH
期刊收录
NSL
期刊等级
2区
成果收录
SCIE
资助标注
Provincial Science and Technology Innovation Special Fund Project of Jilin Province [20190302026GX]; Natural Science Foundation of Jilin Province [20200201037JC]

作者

  • Z

    Zhang, Jianrong (第一作者)

    jilin univ

  • Z

    Zhao, Hongwei

    jilin univ

查看全部 3 位作者收起作者
  • L

    Li, Jiao (通讯)

    dept jilin univ · jilin univ

登录解锁更多功能

  • 收藏这篇,随时在“我的 · 收藏”找回
  • 认领你的成果,生成推广素材
  • 关注作者获取最新成果
  • 加入项目组、协同写作
注册 / 登录

产品服务

  • 科研之友
  • 创新城
  • 科创云

服务支持

  • 帮助中心
  • 隐私政策
  • 服务条款

联系方式

在线客服:【】
客服热线:400-1616-289
电子邮箱:support@scholarmate.com

关注或下载科研之友

微信二维码
微信公众号
客户端下载二维码
下载客户端
科研成果科研人员科研机构科研动态爱瑞思软件

©2026 深圳市科研之友网络服务有限公司

公安备案图标粤公网安备 44030502000213
粤ICP备 16046710 号粤B2-20110417