ScholarMate
English简体中文繁體中文
客服热线:400-1616-289
登录注册
期刊论文

Multi-Projection Fusion and Refinement Network for Salient Object Detection in 360° Omnidirectional Image

Cong, Runmin; Huang, Ke; Lei, Jianjun*; Zhao, Yao; Huang, Qingming; Kwong, Sam北京交通大学; 山东大学; 天津大学; 中国科学院研究生院; 中国科学院
IEEE Transactions on Neural Networks and Learning Systems2023-1-9DOI: 10.1109/TNNLS.2022.3233883
4阅读
引用收藏
分享

摘要

Salient object detection (SOD) aims to determine the most visually attractive objects in an image. With the devel-opment of virtual reality (VR) technology, 360(?) omnidirectional image has been widely used, but the SOD task in 360(?) omni-directional image is seldom studied due to its severe distortions and complex scenes. In this article, we propose a multi-projection fusion and refinement network (MPFR-Net) to detect the salient objects in 360(?) omnidirectional image. Different from the existing methods, the equirectangular projection (EP) image and four corresponding cube-unfolding (CU) images are embedded into the network simultaneously as inputs, where the CU images not only provide supplementary information for EP image but also ensure the object integrity of cube-map projection. In order to make full use of these two projection modes, a dynamic weighting fusion (DWF) module is designed to adaptively integrate the features of different projections in a complementary and dynamic manner from the perspective of inter and intrafeatures. Furthermore,

学科与关键词

关键词
360? omnidirectional imagecube-unfolding (CU)dynamic weightingfiltration and refinement (FR)salient object detection (SOD)
相关
加载中…
  • Attentive and context-aware deep network for saliency prediction on omni-directional images
    Qing, Chunmei; Zhu, Huansheng; Xing, Xiaofen*; Chen, Dongwen; Jin, JianxiuDigital Signal Processing: A Review Journal , 2022, 120: 103289.被引 4
  • Intra- and Inter-Reasoning Graph Convolutional Network for Saliency Prediction on 360° Images
    Chen, Dongwen; Qing, Chunmei*; Lin, Xu; Ye, Mengtao; Xu, Xiangmin; Dickinson, PatrickIEEE Transactions on Circuits and Systems for Video Technology, 2022, 32(12): 8730-8743.
  • SalBiNet360: Saliency Prediction on 360° Images with Local-Global Bifurcated Deep Network
    Chen, Dongwen; Qing, Chunmei*; Xu, Xiangmin; Zhu, Huansheng27th IEEE Conference on Virtual Reality and 3D User Interfaces (IEEE VR), Atlanta, GA, 2020-03-22 To 2020-03-26.被引 7
查看全部 →

发表信息

论文状态
公开发表
期刊
IEEE Transactions on Neural Networks and Learning Systems
发表日期
2023-01-09
DOI
10.1109/TNNLS.2022.3233883
语言
ENGLISH
成果收录
SCIE
资助标注
National Key Research and Development Program of China [2021ZD0112100]; Beijing Nova Program [Z201100006820016]; National Natural Science Foundation of China [62002014, U1936212, 62120106009, 62236008, U21B2038, 61931008]; Hong Kong Innovation and Technology Commission [InnoHK Project the Centre for Intelligent Multidimensional Data Analysis (CIMDA)]; Hong Kong GRF-Research Grants Council (RGC) General Research Fund [11209819 (CityU 9042816), 11203820 (CityU 9042598)]; Young Elite Scientist Sponsorship Program by the China Association for Science and Technology [2020QNRC001]; Chinese Association for Artificial Intelligence (CAAI)-Huawei Fund

作者

  • C

    Cong, Runmin (第一作者)

    shandong univ · beijing jiaotong univ

  • H

    Huang, Ke

    beijing jiaotong univ

查看全部 6 位作者收起作者
  • L

    Lei, Jianjun (通讯)

    tianjin univ

  • Z

    Zhao, Yao

    beijing jiaotong univ

  • H

    Huang, Qingming

    chinese acad sci · univ chinese acad sci

  • K

    Kwong, Sam

登录解锁更多功能

  • 收藏这篇,随时在“我的 · 收藏”找回
  • 认领你的成果,生成推广素材
  • 关注作者获取最新成果
  • 加入项目组、协同写作
注册 / 登录

产品服务

  • 科研之友
  • 创新城
  • 科创云

服务支持

  • 帮助中心
  • 隐私政策
  • 服务条款

联系方式

在线客服:【】
客服热线:400-1616-289
电子邮箱:support@scholarmate.com

关注或下载科研之友

微信二维码
微信公众号
客户端下载二维码
下载客户端
科研成果科研人员科研机构科研动态爱瑞思软件

©2026 深圳市科研之友网络服务有限公司

公安备案图标粤公网安备 44030502000213
粤ICP备 16046710 号粤B2-20110417