ScholarMate
English简体中文繁體中文
客服热线:400-1616-289
登录注册
期刊论文

Image Quality Assessment: Unifying Structure and Texture Similarity

Ding, Keyan*; Ma, Kede; Wang, Shiqi; Simoncelli, Eero P.new
IEEE Transactions on Pattern Analysis and Machine Intelligence2022-5-1DOI: 10.1109/TPAMI.2020.3045810
182被引13阅读
引用收藏
分享

摘要

Objective measures of image quality generally operate by comparing pixels of a "degraded" image to those of the original. Relative to human observers, these measures are overly sensitive to resampling of texture regions (e.g., replacing one patch of grass with another). Here, we develop the first full-reference image quality model with explicit tolerance to texture resampling. Using a convolutional neural network, we construct an injective and differentiable function that transforms images to multi-scale overcomplete representations. We demonstrate empirically that the spatial averages of the feature maps in this representation capture texture appearance, in that they provide a set of sufficient statistical constraints to synthesize a wide variety of texture patterns. We then describe an image quality method that combines correlations of these spatial averages ("texture similarity") with correlations of the feature maps ("structure similarity"). The parameters of the proposed measure are jointly optimized to match human ratings of image quality, while minimizing the reported distances between subimages cropped from the same texture images. Experiments show that the optimized method explains human perceptual scores, both on conventional image quality databases, as well as on texture databases. The measure also offers competitive performance on related tasks such as texture classification and retrieval. Finally, we show that our method is relatively insensitive to geometric transformations (e.g., translation and dilation), without use of any specialized training or data augmentation. Code is available at https://github.com/dingkeyan93/DISTS.

学科与关键词

关键词
VisualizationImage qualityDistortion measurementNonlinear distortionIndexesDatabasesConvolutionImage quality assessmentstructure similaritytexture similarityperceptual optimization
相关
加载中…

文献加载失败,请重试

重试

发表信息

论文状态
公开发表
期刊
IEEE Transactions on Pattern Analysis and Machine Intelligence
发表日期
2022-05-01
卷期
第 44 卷, 第 5 期
页码
2567-2581
DOI
10.1109/TPAMI.2020.3045810
语言
ENGLISH
期刊等级
1区
成果收录
SCIE
资助标注
National Natural Science Foundation of China [62071407, 62022002]; CityU [7005560, 9610487]; Hong Kong RGC Early Career Scheme [9048122]; Howard Hughes Medical Institute; Simons Foundation

作者

  • D

    Ding, Keyan (通讯) (第一作者)

  • M

    Ma, Kede

查看全部 4 位作者收起作者
  • W

    Wang, Shiqi

  • S

    Simoncelli, Eero P.

    new

登录解锁更多功能

  • 收藏这篇,随时在“我的 · 收藏”找回
  • 认领你的成果,生成推广素材
  • 关注作者获取最新成果
  • 加入项目组、协同写作
注册 / 登录

产品服务

  • 科研之友
  • 创新城
  • 科创云

服务支持

  • 帮助中心
  • 隐私政策
  • 服务条款

联系方式

在线客服:【】
客服热线:400-1616-289
电子邮箱:support@scholarmate.com

关注或下载科研之友

微信二维码
微信公众号
客户端下载二维码
下载客户端
科研成果科研人员科研机构科研动态爱瑞思软件

©2026 深圳市科研之友网络服务有限公司

公安备案图标粤公网安备 44030502000213
粤ICP备 16046710 号粤B2-20110417