ScholarMate
English简体中文繁體中文
客服热线:400-1616-289
登录注册
期刊论文

On the Co-Selection of Vision Transformer Features and Images for Very High-Resolution Image Scene Classification

Chaib, Souleyman; Mansouri, Dou El Kefel; Omara, Ibrahim; Hagag, Ahmed; Dhelim, Sahraoui*; Bensaber, Djamel Amar
Remote Sensing2022-11DOI: 10.3390/rs14225817
10被引6阅读
引用收藏
分享

摘要

Recent developments in remote sensing technology have allowed us to observe the Earth with very high-resolution (VHR) images. VHR imagery scene classification is a challenging problem in the field of remote sensing. Vision transformer (ViT) models have achieved breakthrough results in image recognition tasks. However, transformer-encoder layers encode different levels of features, where the latest layer represents semantic information, in contrast to the earliest layers, which contain more detailed data but ignore the semantic information of an image scene. In this paper, a new deep framework is proposed for VHR scene understanding by exploring the strengths of ViT features in a simple and effective way. First, pre-trained ViT models are used to extract informative features from the original VHR image scene, where the transformer-encoder layers are used to generate the feature descriptors of the input images. Second, we merged the obtained features as one signal data set. Third, some extracted ViT features do not describe well the image scenes, such as agriculture, meadows, and beaches, which could negatively affect the performance of the classification model. To deal with this challenge, we propose a new algorithm for feature- and image selection. Indeed, this gives us the possibility of eliminating the less important features and images, as well as those that are abnormal; based on the similarity of preserving the whole data set, we selected the most informative features and important images by dropping the irrelevant images that degraded the classification accuracy. The proposed method was tested on three VHR benchmarks. The experimental results demonstrate that the proposed method outperforms other state-of-the-art methods.

学科与关键词

关键词
very high-resolution images (VHRI)vision transformer (ViT)image scene classificationdeep features
相关
加载中…
  • SCViT: A Spatial-Channel Feature Preserving Vision Transformer for Remote Sensing Image Scene Classification
    Lv, Pengyuan*; Wu, Wenjun; Zhong, Yanfei; Du, Fang; Zhang, LiangpeiIEEE Transactions on Geoscience and Remote Sensing, 2022, 60: 4409512.被引 101
  • Vision Transformers for Remote Sensing Image Classification
    Bazi, Yakoub*; Bashmal, Laila; Rahhal, Mohamad M. Al; Dayil, Reham Al; Ajlan, Naif AlRemote Sensing, 2021, 13(3): 516.被引 307
  • Vision Transformer: An Excellent Teacher for Guiding Small Networks in Remote Sensing Image Scene Classification
    Xu, Kejie; Deng, Peifang; Huang, Hong*IEEE Transactions on Geoscience and Remote Sensing, 2022, 60: 5618715.被引 67
查看全部 →

发表信息

论文状态
公开发表
期刊
Remote Sensing
发表日期
2022-11
卷期
第 14 卷, 第 22 期
页码
5817
DOI
10.3390/rs14225817
语言
ENGLISH
期刊等级
2区
成果收录
SCIE

作者

  • C

    Chaib, Souleyman (第一作者)

  • M

    Mansouri, Dou El Kefel

查看全部 6 位作者收起作者
  • O

    Omara, Ibrahim

  • H

    Hagag, Ahmed

  • D

    Dhelim, Sahraoui (通讯)

  • B

    Bensaber, Djamel Amar

登录解锁更多功能

  • 收藏这篇,随时在“我的 · 收藏”找回
  • 认领你的成果,生成推广素材
  • 关注作者获取最新成果
  • 加入项目组、协同写作
注册 / 登录

产品服务

  • 科研之友
  • 创新城
  • 科创云

服务支持

  • 帮助中心
  • 隐私政策
  • 服务条款

联系方式

在线客服:【】
客服热线:400-1616-289
电子邮箱:support@scholarmate.com

关注或下载科研之友

微信二维码
微信公众号
客户端下载二维码
下载客户端
科研成果科研人员科研机构科研动态爱瑞思软件

©2026 深圳市科研之友网络服务有限公司

公安备案图标粤公网安备 44030502000213
粤ICP备 16046710 号粤B2-20110417