摘要
Understanding visual attention of observers on omni-directional images gains interest along with the booming trend of virtual reality applications. In this paper, we propose a novel attentive and context-aware network for saliency prediction on omni-directional images, which is named as ACSalNet. In this architecture, considering the problem of insufficient receptive fields of high-level features, a Deformable Attention Bottleneck (DAB) is first proposed to strengthen the high-level feature extractor and effectively focus the limited receptive field of the model to the key areas. Then, to reduce the semantic gap between features of different levels and introduce context-aware information, we further design a Context-aware Feature Pyramid Module (CFPM). In the testing phase, in order to reduce the error of prediction directly on the equirectangular images while retaining their integrity, a novel projection method called Multiple Sphere Rotation (MSR) is proposed. Extensive experiments illustrate that the proposed method outperforms the state-of-the-art models under different evaluation metrics on the public saliency benchmarks.
学科与关键词
- SalBiNet360: Saliency Prediction on 360° Images with Local-Global Bifurcated Deep NetworkChen, Dongwen; Qing, Chunmei*; Xu, Xiangmin; Zhu, Huansheng27th IEEE Conference on Virtual Reality and 3D User Interfaces (IEEE VR), Atlanta, GA, 2020-03-22 To 2020-03-26.被引 7
- MULTI-SCALE TRANSFORMER NETWORK FOR SALIENCY PREDICTION ON 360-DEGREE IMAGESLin, Xu; Qing, Chunmei*; Tan, Junpeng; Xu, Xiangmin30th IEEE International Conference on Image Processing (ICIP), Kuala Lumpur, MALAYSIA, 2023-10-08 To 2023-10-11.
- Multi-Projection Fusion and Refinement Network for Salient Object Detection in 360° Omnidirectional ImageCong, Runmin; Huang, Ke; Lei, Jianjun*; Zhao, Yao; Huang, Qingming; Kwong, SamIEEE Transactions on Neural Networks and Learning Systems, 2023.
