ScholarMate
English简体中文繁體中文
客服热线:400-1616-289
登录注册
期刊论文

PSTAF-GAN: Progressive Spatio-Temporal Attention Fusion Method Based on Generative Adversarial Network

Liu, Qiang; Meng, Xiangchao*; Shao, Feng*; Li, Shutaoningbo univ; hunan univ
IEEE Transactions on Geoscience and Remote Sensing2022DOI: 10.1109/TGRS.2022.3161563
15被引15阅读
引用收藏
分享

摘要

Spatio-temporal fusion aims to integrate multisource remote sensing images with complementary high spatial and temporal resolutions, so as to obtain time-series high spatial resolution fused images. Currently, deep learning (DL)-based spatio-temporal fusion methods have received broad attention. However, on one hand, most of the existing DL-based methods train the model in a band-by-band manner, ignoring the correlations among bands. On the other hand, the general coarse spatio-temporal changes in low spatial resolution images (e.g., MODIS) calculated at the pixel domain cannot completely cover the fine spatio-temporal changes in high spatial resolution images (e.g., Landsat), due to complex surface features and the general large spatial resolution ratio between fine and coarse images. Besides, the existing DL-based spatio-temporal fusion methods are insufficient in exploring multiscale information by only stacking convolutional kernels with different sizes. To alleviate the above challenges, we propose a progressive spatio-temporal attention fusion model in a multiband training manner based on generative adversarial network (PSTAF-GAN). Specifically, we design a flexible multiscale feature extraction architecture to extract multiscale feature hierarchies. Then, spatio-temporal changes are calculated on the feature domain in different feature hierarchies. Besides, a spatio-temporal attention fusion architecture is proposed to fuse the spatio-temporal changes and ground details in a coarse-to-fine manner, which can explore multiscale information more sufficient and gradually recover the target image. The results of quantitative and qualitative experiments on two publicly available benchmark datasets show that the proposed PSTAF-GAN can achieve the best performance compared with the state-of-the-art methods.

学科与关键词

关键词
Feature extractionSpatial resolutionImage resolutionGenerative adversarial networksConvolutionPredictive modelsConvolutional neural networksGenerative adversarial network (GAN)multilevel featureremote sensingspatio-temporal attention fusionweight sharing
相关
加载中…

文献加载失败,请重试

重试

发表信息

论文状态
公开发表
期刊
IEEE Transactions on Geoscience and Remote Sensing
发表日期
2022
卷期
第 60 卷
页码
5408513
DOI
10.1109/TGRS.2022.3161563
语言
ENGLISH
期刊等级
2区
成果收录
SCIE
资助标注
National Natural Science Foundation of China [42171326, 41801252, 62071261]; Natural Science Foundation of Zhejiang Province [LY22F010014]; Fellowship of China Postdoctoral Science Foundation [2020M672490]; K. C. Wong Magna Fund in Ningbo University

作者

  • L

    Liu, Qiang (第一作者)

    ningbo univ

  • M

    Meng, Xiangchao (通讯)

    ningbo univ · hunan univ

查看全部 4 位作者收起作者
  • S

    Shao, Feng (通讯)

    ningbo univ

  • L

    Li, Shutao

    hunan univ

登录解锁更多功能

  • 收藏这篇,随时在“我的 · 收藏”找回
  • 认领你的成果,生成推广素材
  • 关注作者获取最新成果
  • 加入项目组、协同写作
注册 / 登录

产品服务

  • 科研之友
  • 创新城
  • 科创云

服务支持

  • 帮助中心
  • 隐私政策
  • 服务条款

联系方式

在线客服:【】
客服热线:400-1616-289
电子邮箱:support@scholarmate.com

关注或下载科研之友

微信二维码
微信公众号
客户端下载二维码
下载客户端
科研成果科研人员科研机构科研动态爱瑞思软件

©2026 深圳市科研之友网络服务有限公司

公安备案图标粤公网安备 44030502000213
粤ICP备 16046710 号粤B2-20110417