摘要
Salient object detection (SOD) aims to determine the most visually attractive objects in an image. With the devel-opment of virtual reality (VR) technology, 360(?) omnidirectional image has been widely used, but the SOD task in 360(?) omni-directional image is seldom studied due to its severe distortions and complex scenes. In this article, we propose a multi-projection fusion and refinement network (MPFR-Net) to detect the salient objects in 360(?) omnidirectional image. Different from the existing methods, the equirectangular projection (EP) image and four corresponding cube-unfolding (CU) images are embedded into the network simultaneously as inputs, where the CU images not only provide supplementary information for EP image but also ensure the object integrity of cube-map projection. In order to make full use of these two projection modes, a dynamic weighting fusion (DWF) module is designed to adaptively integrate the features of different projections in a complementary and dynamic manner from the perspective of inter and intrafeatures. Furthermore,
学科与关键词
- Attentive and context-aware deep network for saliency prediction on omni-directional imagesQing, Chunmei; Zhu, Huansheng; Xing, Xiaofen*; Chen, Dongwen; Jin, JianxiuDigital Signal Processing: A Review Journal , 2022, 120: 103289.被引 4
- Intra- and Inter-Reasoning Graph Convolutional Network for Saliency Prediction on 360° ImagesChen, Dongwen; Qing, Chunmei*; Lin, Xu; Ye, Mengtao; Xu, Xiangmin; Dickinson, PatrickIEEE Transactions on Circuits and Systems for Video Technology, 2022, 32(12): 8730-8743.
- SalBiNet360: Saliency Prediction on 360° Images with Local-Global Bifurcated Deep NetworkChen, Dongwen; Qing, Chunmei*; Xu, Xiangmin; Zhu, Huansheng27th IEEE Conference on Virtual Reality and 3D User Interfaces (IEEE VR), Atlanta, GA, 2020-03-22 To 2020-03-26.被引 7
