摘要
The research in image quality assessment (IQA) has a long history, and significant progress has been made by leveraging recent advances in deep neural networks (DNNs). Despite high correlation numbers on existing IQA datasets, DNN-based models may be easily falsified in the group maximum differentiation (gMAD) competition. Here we show that gMAD examples can be used to improve blind IQA (BIQA) methods. Specifically, we first pre-train a DNN-based BIQA model using multiple noisy annotators, and fine-tune it on multiple synthetically distorted images, resulting in a "top-performing" baseline model. We then seek pairs of images by comparing the baseline model with a set of full-reference IQA methods in gMAD. The spotted gMAD examples are most likely to reveal the weaknesses of the baseline, and suggest potential ways for refinement. We query human quality annotations for the selected images in a well-controlled laboratory environment, and further fine-tune the baseline on the combination of human-rated images from gMAD and existing databases. This process may be iterated, enabling active fine-tuning from gMAD examples for BIQA. We demonstrate the feasibility of our active learning scheme on a large-scale unlabeled image set, and show that the fine-tuned quality model achieves improved generalizability in gMAD, without destroying performance on previously seen databases.
学科与关键词
- Toward a blind image quality evaluator in the wild by learning beyond human opinion scoresWang, Zhihua; Tang, Zhi-Ri; Zhang, Jianguo*; Fang, YumingPattern Recognition, 2023, 137: 109296.被引 1
- DACNN: Blind Image Quality Assessment via a Distortion-Aware Convolutional Neural NetworkPan, Zhaoqing; Zhang, Hao; Lei, Jianjun*; Fang, Yuming; Shao, Xiao; Ling, Nam; Kwong, SamIEEE Transactions on Circuits and Systems for Video Technology, 2022, 32(11): 7518-7531.被引 18
- Blind Image Quality Assessment via Vision-Language Correspondence: A Multitask Learning PerspectiveZhang, Weixia; Zhai, Guangtao; Wei, Ying; Yang, Xiaokang; Ma, Kede*IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Vancouver, CANADA, 2023-06-17 To 2023-06-24.被引 7
