摘要
With the development of the virtual reality applications, predicting human visual attention on 360 degrees images is valuable to content creators and encoding algorithms, and becomes essential to understand user behaviour. In this paper, we propose a local-global bifurcated deep network for saliency prediction on 360 degrees images, which is named as SalBiNet360. In the global deep sub-network, multiple multi-scale contextual modules and a multilevel decoder are utilized to integrate the features from the middle and deep layers of the network. In the local deep sub-network, only one multi-scale contextual module and a single-level decoder are utilized to reduce the redundancy of local saliency maps. Finally, fused saliency maps are generated by linear combination of the global and local saliency maps. Experiments on two publicly available datasets illustrate that the proposed SalBiNet360 outperforms the tested state-of-the-art methods.
学科与关键词
- MULTI-SCALE TRANSFORMER NETWORK FOR SALIENCY PREDICTION ON 360-DEGREE IMAGESLin, Xu; Qing, Chunmei*; Tan, Junpeng; Xu, Xiangmin30th IEEE International Conference on Image Processing (ICIP), Kuala Lumpur, MALAYSIA, 2023-10-08 To 2023-10-11.
- Attentive and context-aware deep network for saliency prediction on omni-directional imagesQing, Chunmei; Zhu, Huansheng; Xing, Xiaofen*; Chen, Dongwen; Jin, JianxiuDigital Signal Processing: A Review Journal , 2022, 120: 103289.被引 4
- Intra- and Inter-Reasoning Graph Convolutional Network for Saliency Prediction on 360° ImagesChen, Dongwen; Qing, Chunmei*; Lin, Xu; Ye, Mengtao; Xu, Xiangmin; Dickinson, PatrickIEEE Transactions on Circuits and Systems for Video Technology, 2022, 32(12): 8730-8743.
