ScholarMate
English简体中文繁體中文
客服热线:400-1616-289
登录注册
期刊论文

Combining CNN and transformers for full-reference and no-reference image quality assessment

Zeng, Chao; Kwong, Sam*hubei univ
NEUROCOMPUTING2023-9-7DOI: 10.1016/j.neucom.2023.126437
8阅读
引用收藏
分享

摘要

Most deep learning approaches for image quality assessment use regression from deep features extracted by CNN (Convolutional Neural Networks). However, non-local information is usually neglected in exist-ing methods. Motivated by the recent success of transformers in modeling contextual information, we propose a hybrid framework that utilizes a vision transformer backbone to extract features and a CNN decoder for quality estimation. We propose a shared feature extraction scheme for both FR and NR set-tings. A two-branch structured attentive quality predictor is devised for quality prediction. Evaluation experiments on various IQA datasets, including LIVE, CSIQ and TID2013, LIVE-Challenge, KADID-10 K, and KONIQ-10 K, show that our proposed models achieve outstanding performance for both FR and NR settings.& COPY; 2023 Published by Elsevier B.V.

学科与关键词

关键词
Image quality assessmentConvolutional neural networkTransformersNon-local information
相关
加载中…
  • Perception-Oriented U-Shaped Transformer Network for 360-Degree No-Reference Image Quality Assessment
    Zhou, Mingliang; Chen, Lei; Wei, Xuekai*; Liao, Xingran; Mao, Qin*; Wang, Heqiang; Pu, Huayan; Luo, Jun; Xiang, Tao; Fang, BinIEEE Transactions on Broadcasting, 2023, 69(2): 396-405.被引 8
  • No-reference image quality assessment by using convolutional neural networks via object detection
    Cao, Jingchao; Wu, Wenhui; Wang, Ran*; Kwong, SamInternational Journal of Machine Learning and Cybernetics, 2022, 13(11): 3543-3554.被引 2
  • An End-to-End Blind Image Quality Assessment Method Using a Recurrent Network and Self-Attention
    Zhou, Mingliang; Lan, Xuting; Wei, Xuekai*; Liao, Xingran; Mao, Qin*; Li, Yutong; Wu, Chao; Xiang, Tao; Fang, BinIEEE Transactions on Broadcasting, 2023, 69(2): 369-377.被引 8
查看全部 →

发表信息

论文状态
公开发表
期刊
NEUROCOMPUTING
发表日期
2023-09-07
卷期
第 549 卷
页码
126437
DOI
10.1016/j.neucom.2023.126437
语言
ENGLISH
成果收录
SCIE
资助标注
Ministry of Science and Technology of China [2018AAA0101301]; Hong Kong Innovation and Technology Commission; Hong Kong GRF-RGC General Research Fund [11209819 (CityU 9042816), 11203820 (9042598)]

作者

  • Z

    Zeng, Chao (第一作者)

    hubei univ

  • K

    Kwong, Sam (通讯)

登录解锁更多功能

  • 收藏这篇,随时在“我的 · 收藏”找回
  • 认领你的成果,生成推广素材
  • 关注作者获取最新成果
  • 加入项目组、协同写作
注册 / 登录

产品服务

  • 科研之友
  • 创新城
  • 科创云

服务支持

  • 帮助中心
  • 隐私政策
  • 服务条款

联系方式

在线客服:【】
客服热线:400-1616-289
电子邮箱:support@scholarmate.com

关注或下载科研之友

微信二维码
微信公众号
客户端下载二维码
下载客户端
科研成果科研人员科研机构科研动态爱瑞思软件

©2026 深圳市科研之友网络服务有限公司

公安备案图标粤公网安备 44030502000213
粤ICP备 16046710 号粤B2-20110417