ScholarMate
English简体中文繁體中文
客服热线:400-1616-289
登录注册
期刊论文

Two-stream spatiotemporal image fusion network based on difference transformation

Fang, Shuai; Meng, Siyuan; Zhang, Jing; Cao, Yang*y
Journal of Applied Remote Sensing2022-7-1DOI: 10.1117/1.JRS.16.038506
5阅读
引用收藏
分享

摘要

For satellite imaging instruments, the tradeoff between spatial and temporal resolution leads to the spatial-temporal contradiction of image sequences. Spatiotemporal image fusion (STIF) provides a solution to generate images with both high-spatial and high-temporal resolutions, thus expanding the applications of existing satellite images. Most deep learning-based STIF methods throw the task to network as a whole and construct an end-to-end model without caring about the intermediate physical process. This leads to high complexity, less interpretability, and low accuracy of the fusion model. To address this problem, we propose a two-stream difference transformation spatiotemporal fusion (TSDTSF), which includes transformation and fusion streams. In the transformation stream, an image difference transformation module reduces the pixel distribution difference of images from different sensors with the same spatial resolution, and a feature difference transformation module improves the feature quality of low-resolution images. The fusion stream focuses on feature fusion and image reconstruction. The TSDTSF shows superior performance in accuracy, vision quality, and robustness. The experimental results show that TSDTSF achieves the effect of the average coefficient of determination (R-2 = 0.7847) and the root mean square error (RMSE = 0.0266), which is better than the suboptimal method average (R-2 = 0.7519) and (RMSE = 0.0289). The quantitative and qualitative experimental results on various datasets demonstrate our superiority over the state-of-the-art methods.

学科与关键词

关键词
spatiotemporal image fusionconvolutional neural networkdeep learningremote sensing
相关
加载中…
  • WDBSTF: A Weighted Dual-Branch Spatiotemporal Fusion Network Based on Complementarity between Super-Resolution and Change Prediction
    Fang, Shuai; Guo, Qing*; Cao, YangRemote Sensing, 2022, 14(22): 5883.被引 1
  • Deep Learning-Based Spatiotemporal Data Fusion Using a Patch-to-Pixel Mapping Strategy and Model Comparisons
    Ao, Zurui; Sun, Ying; Pan, Xiaoyu; Xin, Qinchuan*IEEE Transactions on Geoscience and Remote Sensing, 2022, 60: 5407718.被引 18
  • A Dual-Perspective Spatiotemporal Fusion Model for Remote Sensing Images by Discriminative Learning of the Spatial and Temporal Mapping
    Qian, Zhonghua; Yue, Linwei*; Xie, Xiao*; Yuan, Qiangqiang; Shen, HuanfengIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2024, 17: 12505-12520.
查看全部 →

发表信息

论文状态
公开发表
期刊
Journal of Applied Remote Sensing
发表日期
2022-07-01
卷期
第 16 卷, 第 3 期
页码
038506
DOI
10.1117/1.JRS.16.038506
语言
ENGLISH
期刊等级
4区
成果收录
SCIE
资助标注
National Key R&D Program of China [2018YFC0213104]; National Natural Science Foundation of China [61872327, 61175033]; Fundamental Research Funds for the Central Universities [WK2380000001]; Major Special Science and Technology Project of Anhui [012223665049]

作者

  • F

    Fang, Shuai (第一作者)

  • M

    Meng, Siyuan

查看全部 4 位作者收起作者
  • Z

    Zhang, Jing

  • C

    Cao, Yang (通讯)

    univ sci & technol china

登录解锁更多功能

  • 收藏这篇,随时在“我的 · 收藏”找回
  • 认领你的成果,生成推广素材
  • 关注作者获取最新成果
  • 加入项目组、协同写作
注册 / 登录

产品服务

  • 科研之友
  • 创新城
  • 科创云

服务支持

  • 帮助中心
  • 隐私政策
  • 服务条款

联系方式

在线客服:【】
客服热线:400-1616-289
电子邮箱:support@scholarmate.com

关注或下载科研之友

微信二维码
微信公众号
客户端下载二维码
下载客户端
科研成果科研人员科研机构科研动态爱瑞思软件

©2026 深圳市科研之友网络服务有限公司

公安备案图标粤公网安备 44030502000213
粤ICP备 16046710 号粤B2-20110417