ScholarMate
English简体中文繁體中文
客服热线:400-1616-289
登录注册
会议论文

HL-Net: Heterophily Learning Network for Scene Graph Generation

Lin, Xin; Ding, Changxing*; Zhan, Yibing; Li, Zijian; Tao, Dacheng
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)2022DOI: 10.1109/CVPR52688.2022.01887
5被引3阅读
引用收藏
分享

摘要

Scene graph generation (SGG) aims to detect objects and predict their pairwise relationships within an image. Current SGG methods typically utilize graph neural networks (GNN,$) to acquire context information between objects/relationships. Despite their effectiveness, however, current SGG methods only assume scene graph homophily while ignoring heterophily. Accordingly, in this paper, we propose a novel Heterophily Learning Network (HL-Net) to comprehensively explore the homophily and heterophily between objects/relationships in scene graphs. More specifically, HL-Net comprises the following 1) an adaptive reweighting transformer module, which adaptively integrates the information from different layers to exploit both the heterophily and homophily in objects; 2) a relationship feature propagation module that efficiently explores the connections between relationships by considering heterophily in order to refine the relationship representation; 3) a heterophily-aware message-passing scheme to further distinguish the heterophily and homophily between objects/relationships, thereby facilitating improved message passing in graphs. We conducted extensive experiments on two public datasets: Visual Genome (VG) and Open Images (OI). The experimental results demonstrate the superiority of our proposed HL-Net over existing state-of-the-art approaches. In more detail, HL-Net outperforms the second-best competitors by 2.1% on the VG dataset for scene graph classification and 1.2% on the 10 dataset for the final score.

相关
加载中…
  • GPS-Net: Graph Property Sensing Network for Scene Graph Generation
    Lin, Xin; Ding, Changxing; Zeng, Jinquan; Tao, DachengIEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), ELECTR NETWORK, 2020-06-14 To 2020-06-19.被引 98
  • RU-Net: Regularized Unrolling Network for Scene Graph Generation
    Lin, Xin; Ding, Changxing*; Zhang, Jing; Zhan, Yibing; Tao, DachengIEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), New Orleans, LA, 2022-06-18 To 2022-06-24.
  • Scene Graph Generation using Depth-based Multimodal Network
    Chen, Lianggangxu*; Lu, Jiale; Wang, Changbo; He, GaoqiIEEE International Conference on Multimedia and Expo (ICME), Brisbane, AUSTRALIA, 2023-07-10 To 2023-07-14.
查看全部 →

会议信息

会议名称
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
会议日期
2022-06-18 至 2022-06-24
论文集名
2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022)
发表日期
2022
起止页码
19454-19463
DOI
10.1109/CVPR52688.2022.01887
资助标注
NSF of China [62076101, 62002090]; Program for Guangdong Introducing Innovative and Entrepreneurial Teams [2017ZT07X183]
收录
ISTP

作者

  • L

    Lin, Xin (第一作者)

  • D

    Ding, Changxing (通讯)

查看全部 5 位作者收起作者
  • Z

    Zhan, Yibing

  • L

    Li, Zijian

  • T

    Tao, Dacheng

登录解锁更多功能

  • 收藏这篇,随时在“我的 · 收藏”找回
  • 认领你的成果,生成推广素材
  • 关注作者获取最新成果
  • 加入项目组、协同写作
注册 / 登录

产品服务

  • 科研之友
  • 创新城
  • 科创云

服务支持

  • 帮助中心
  • 隐私政策
  • 服务条款

联系方式

在线客服:【】
客服热线:400-1616-289
电子邮箱:support@scholarmate.com

关注或下载科研之友

微信二维码
微信公众号
客户端下载二维码
下载客户端
科研成果科研人员科研机构科研动态爱瑞思软件

©2026 深圳市科研之友网络服务有限公司

公安备案图标粤公网安备 44030502000213
粤ICP备 16046710 号粤B2-20110417