ScholarMate
English简体中文繁體中文
客服热线:400-1616-289
登录注册
期刊论文

Spatiotemporal contrastive modeling for video moment retrieval

Wang, Yi; Li, Kun*; Chen, Guoliang*; Zhang, Yan; Guo, Dan; Wang, Meng
WORLD WIDE WEB-INTERNET AND WEB INFORMATION SYSTEMS2023-7DOI: 10.1007/s11280-022-01105-3
12阅读
引用收藏
分享

摘要

With the rapid development of social networks, video data has been growing explosively. As one of the important social mediums, spatiotemporal characteristics of videos have attracted considerable attention in recommendation system and video understanding. In this paper, we discuss the video moment retrieval (VMR) task, which locates moments in a video based on different textual queries. Existing methods are of two pipelines: 1) proposal-free approaches are mainly in modifying multi-modal interaction strategy; 2) proposal-based methods are dedicated to designing advanced proposal generation paradigm. Recently, contrastive representation learning has been successfully applied to the field of video understanding. From a new perspective, we propose a new VMR framework, named spatiotemporal contrastive network (STCNet), to learn discriminative boundary features of video grounding by contrast learning. To be specific, we propose a boundary matching sampling module for dense negative sample sampling. The contrast learning can refine the feature representations in the training phase without any additional cost in inference. On three public datasets, Charades-STA, ActivityNet Captions and TACoS, our proposed method performs competitive performance.

学科与关键词

关键词
Video moment retrievalSpatiotemporal modelingContrastive learningLanguage queryTemporal localization
相关
加载中…
  • Video Moment Retrieval With Cross-Modal Neural Architecture Search
    Yang, Xun; Wang, Shanshan; Dong, Jian; Dong, Jianfeng; Wang, Meng; Chua, Tat-SengIEEE Transactions on Image Processing, 2022, 31: 1204-1216.被引 23
  • A Survey on Video Moment Localization
    Liu, Meng; Nie, Liqiang*; Wang, Yunxiao; Wang, Meng; Rui, YongACM Computing Surveys, 2023, 55(9): 188.
  • Contrastive Spatio-Temporal Pretext Learning for Self-Supervised Video Representation
    Zhang, Yujia*; Po, Lai-Man; Xu, Xuyuan; Liu, Mengyang; Wang, Yexin; Ou, Weifeng; Zhao, Yuzhi; Yu, Wing-Yin36th AAAI Conference on Artificial Intelligence / 34th Conference on Innovative Applications of Artificial Intelligence / 12th Symposium on Educational Advances in Artificial Intelligence, ELECTR NETWORK, 2022-02-22 To 2022.被引 3
查看全部 →

发表信息

论文状态
公开发表
期刊
WORLD WIDE WEB-INTERNET AND WEB INFORMATION SYSTEMS
发表日期
2023-07
卷期
第 26 卷, 第 4 期
页码
1525-1544
DOI
10.1007/s11280-022-01105-3
语言
ENGLISH
成果收录
SCIE
资助标注
National Natural Science Foundation of China (NSFC) [61876058, 61725203, 62020106007, U20A20183]

作者

  • W

    Wang, Yi (第一作者)

  • L

    Li, Kun (通讯)

查看全部 6 位作者收起作者
  • C

    Chen, Guoliang (通讯)

  • Z

    Zhang, Yan

  • G

    Guo, Dan

  • W

    Wang, Meng

登录解锁更多功能

  • 收藏这篇,随时在“我的 · 收藏”找回
  • 认领你的成果,生成推广素材
  • 关注作者获取最新成果
  • 加入项目组、协同写作
注册 / 登录

产品服务

  • 科研之友
  • 创新城
  • 科创云

服务支持

  • 帮助中心
  • 隐私政策
  • 服务条款

联系方式

在线客服:【】
客服热线:400-1616-289
电子邮箱:support@scholarmate.com

关注或下载科研之友

微信二维码
微信公众号
客户端下载二维码
下载客户端
科研成果科研人员科研机构科研动态爱瑞思软件

©2026 深圳市科研之友网络服务有限公司

公安备案图标粤公网安备 44030502000213
粤ICP备 16046710 号粤B2-20110417