ScholarMate
English简体中文繁體中文
客服热线:400-1616-289
登录注册
会议论文

Blind Image Quality Assessment via Vision-Language Correspondence: A Multitask Learning Perspective

Zhang, Weixia; Zhai, Guangtao; Wei, Ying; Yang, Xiaokang; Ma, Kede*上海交通大学
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)2023DOI: 10.1109/CVPR52729.2023.01352
7被引5阅读
引用收藏
分享

摘要

We aim at advancing blind image quality assessment (BIQA), which predicts the human perception of image quality without any reference information. We develop a general and automated multitask learning scheme for BIQA to exploit auxiliary knowledge from other tasks, in a way that the model parameter sharing and the loss weighting are determined automatically. Specifically, we first describe all candidate label combinations (from multiple tasks) using a textual template, and compute the joint probability from the cosine similarities of the visual-textual embeddings. Predictions of each task can be inferred from the joint distribution, and optimized by carefully designed loss functions. Through comprehensive experiments on learning three tasks - BIQA, scene classification, and distortion type identification, we verify that the proposed BIQA method 1) benefits from the scene classification and distortion type identification tasks and outperforms the state-of-the-art on multiple IQA datasets, 2) is more robust in the group maximum differentiation competition, and 3) realigns the quality annotations from different IQA datasets more effectively. The source code is available at https://github.com/zwx8981/LIQE.

相关
加载中…
  • Continual Learning for Blind Image Quality Assessment
    Zhang, Weixia; Li, Dingquan; Ma, Chao; Zhai, Guangtao; Yang, Xiaokang; Ma, Kede*IEEE Transactions on Pattern Analysis and Machine Intelligence, 2023, 45(3): 2864-2878.被引 30
  • A Multiscale Approach to Deep Blind Image Quality Assessment
    Liu, Manni; Huang, Jiabin; Zeng, Delu*; Ding, Xinghao; Paisley, JohnIEEE Transactions on Image Processing, 2023, 32: 1656-1667.被引 4
  • Toward a blind image quality evaluator in the wild by learning beyond human opinion scores
    Wang, Zhihua; Tang, Zhi-Ri; Zhang, Jianguo*; Fang, YumingPattern Recognition, 2023, 137: 109296.被引 1
查看全部 →

会议信息

会议名称
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
会议日期
2023-06-17 至 2023-06-24
论文集名
2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR)
发表日期
2023
起止页码
14071-14081
DOI
10.1109/CVPR52729.2023.01352
资助标注
Shanghai Municipal Science and Technology Major Project [2021SHZDZX0102]; Fundamental Research Funds for the Central Universities; National Natural Science Foundation of China [61901262, 62071407]
收录
ISTP

作者

  • Z

    Zhang, Weixia (第一作者)

    shanghai jiao tong univ

  • Z

    Zhai, Guangtao

    shanghai jiao tong univ

查看全部 5 位作者收起作者
  • W

    Wei, Ying

  • Y

    Yang, Xiaokang

    shanghai jiao tong univ

  • M

    Ma, Kede (通讯)

登录解锁更多功能

  • 收藏这篇,随时在“我的 · 收藏”找回
  • 认领你的成果,生成推广素材
  • 关注作者获取最新成果
  • 加入项目组、协同写作
注册 / 登录

产品服务

  • 科研之友
  • 创新城
  • 科创云

服务支持

  • 帮助中心
  • 隐私政策
  • 服务条款

联系方式

在线客服:【】
客服热线:400-1616-289
电子邮箱:support@scholarmate.com

关注或下载科研之友

微信二维码
微信公众号
客户端下载二维码
下载客户端
科研成果科研人员科研机构科研动态爱瑞思软件

©2026 深圳市科研之友网络服务有限公司

公安备案图标粤公网安备 44030502000213
粤ICP备 16046710 号粤B2-20110417