ScholarMate
English简体中文繁體中文
客服热线:400-1616-289
登录注册
期刊论文

Homo-Heterogenous Transformer Learning Framework for RS Scene Classification

Ma, Jingjing; Li, Mingteng; Tang, Xu*; Zhang, Xiangrong; Liu, Fang; Jiao, Licheng南京理工大学; 西安电子科技大学
IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing2022DOI: 10.1109/JSTARS.2022.3155665
38被引7阅读
引用收藏
分享

摘要

Remote sensing (RS) scene classification plays an essential role in the RS community and has attracted increasing attention due to its wide applications. Recently, benefiting from the powerful feature learning capabilities of convolutional neural networks (CNNs), the accuracy of the RS scene classification has significantly been improved. Although the existing CNN-based methods achieve excellent results, there is still room for improvement. First, the CNN-based methods are adept at capturing the global information from RS scenes. Still, the context relationships hidden in RS scenes cannot be thoroughly mined. Second, due to the specific structure, it is easy for normal CNNs to exploit the heterogenous information from RS scenes. Nevertheless, the homogenous information, which is also crucial to comprehensively understand complex contents within RS scenes, does not get the attention it deserves. Third, most CNNs focus on establishing the relationships between RS scenes and semantic labels. However, the similarities between them are not considered deeply, which are helpful to distinguish the intra-/interclass samples. To overcome the limitations mentioned previously, we propose a homo-heterogenous transformer learning (HHTL) framework for the RS scene classification in this article. First, a patch generation module is designed to generate homogenous and heterogenous patches. Then, a dual-branch feature learning module (FLM) is proposed to mine homogenous and heterogenous information within RS scenes simultaneously. In the FLM, based on vision transformer, not only the global information but also the local areas and their context information can be captured. Finally, we design a classification module, which consists of a fusion submodule and a metric-learning module. It can integrate homo-heterogenous information and compact/separate samples from the same/different RS scene categories. Extensive experiments are conducted on four public RS scene datasets. The encouraging results demonstrate that our HHTL framework can outperform many state-of-the-art methods. Our source codes are available at the below website.

学科与关键词

关键词
Feature extractionTransformersRemote sensingSemanticsTask analysisRepresentation learningMeasurementHomo-heterogenous transformermetric learningremote sensing (RS) scene classification
相关
加载中…
  • TRS: Transformers for Remote Sensing Scene Classification
    Zhang, Jianrong; Zhao, Hongwei; Li, Jiao*Remote Sensing, 2021, 13(20): 4143.被引 78
  • Local and Long-Range Collaborative Learning for Remote Sensing Scene Classification
    Zhao, Maofan; Meng, Qingyan*; Zhang, Linlin*; Hu, Xinli; Bruzzone, LorenzoIEEE Transactions on Geoscience and Remote Sensing, 2023, 61: 5606215.被引 23
  • Hierarchical Feature Fusion of Transformer With Patch Dilating for Remote Sensing Scene Classification
    Chen, Xiaoning; Ma, Mingyang; Li, Yong*; Mei, Shaohui; Han, Zonghao; Zhao, Jian; Cheng, WeiIEEE Transactions on Geoscience and Remote Sensing, 2023, 61: 4410516.被引 7
查看全部 →

发表信息

论文状态
公开发表
期刊
IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
发表日期
2022
卷期
第 15 卷
页码
2223-2239
DOI
10.1109/JSTARS.2022.3155665
语言
ENGLISH
期刊等级
3区
成果收录
SCIE
资助标注
National Natural Science Foundation of China [62171332]; Key Research and Development Program of Shaanxi [2021GY-035, 2019ZDLGY03-08]; Fund of National Key Laboratory of Science and Technology on Remote Sensing Information and Imagery Analysis, Beijing Research Institute of Uranium Geology [6142A010301]; China Postdoctoral Science Foundation [2017M620441]; Key Laboratory Program [HLJGXQ20210701008]; Open Research Fund in 2021 of Jiangsu Key Laboratory of Spectral Imaging Intelligent Sense [JSGP202101]

作者

  • M

    Ma, Jingjing (第一作者)

    xidian univ

  • L

    Li, Mingteng

    xidian univ

查看全部 6 位作者收起作者
  • T

    Tang, Xu (通讯)

    xidian univ

  • Z

    Zhang, Xiangrong

    xidian univ

  • L

    Liu, Fang

    nanjing univ sci & technol

  • J

    Jiao, Licheng

    xidian univ

登录解锁更多功能

  • 收藏这篇,随时在“我的 · 收藏”找回
  • 认领你的成果,生成推广素材
  • 关注作者获取最新成果
  • 加入项目组、协同写作
注册 / 登录

产品服务

  • 科研之友
  • 创新城
  • 科创云

服务支持

  • 帮助中心
  • 隐私政策
  • 服务条款

联系方式

在线客服:【】
客服热线:400-1616-289
电子邮箱:support@scholarmate.com

关注或下载科研之友

微信二维码
微信公众号
客户端下载二维码
下载客户端
科研成果科研人员科研机构科研动态爱瑞思软件

©2026 深圳市科研之友网络服务有限公司

公安备案图标粤公网安备 44030502000213
粤ICP备 16046710 号粤B2-20110417