ScholarMate
English简体中文繁體中文
客服热线:400-1616-289
登录注册
期刊论文

A Temporal-Aware Relation and Attention Network for Temporal Action Localization

Zhao, Yibo; Zhang, Hua; Gao, Zan*; Guan, Weili; Nie, Jie*; Liu, Anan; Wang, Meng; Chen, Shengyong中国海洋大学; 天津大学
IEEE Transactions on Image Processing2022-7-8DOI: 10.1109/TIP.2022.3182866
16被引10阅读
引用收藏
分享

摘要

Temporal action localization is currently an active research topic in computer vision and machine learning due to its usage in smart surveillance. It is a challenging problem since the categories of the actions must be classified in untrimmed videos and the start and end of the actions need to be accurately found. Although many temporal action localization methods have been proposed, they require substantial amounts of computational resources for the training and inference processes. To solve these issues, in this work, a novel temporal-aware relation and attention network (abbreviated as TRA) is proposed for the temporal action localization task. TRA has an anchor-free and end-to-end architecture that fully uses temporal-aware information. Specifically, a temporal self-attention module is first designed to determine the relationship between different temporal positions, and more weight is given to features within the actions. Then, a multiple temporal aggregation module is constructed to aggregate the temporal domain information. Finally, a graph relation module is designed to obtain the aggregated graph features, which are used to refine the boundaries and classification results. Most importantly, these three modules are jointly explored in a unified framework, and temporal awareness is always fully used. Extensive experiments demonstrate that the proposed method can outperform all state-of-the-art methods on the THUMOS14 dataset with an average mAP that reaches 67.6% and obtain a comparable result on the ActivityNet1.3 dataset with an average mAP that reaches 34.4%. Compared with A2Net (TIP20), PCG-TAL (TIP21), and AFSD (CVPR21) TRA can achieve improvements of 11.7%, 4.4%, and 1.8%, respectively on the THUMOS14 dataset.

学科与关键词

关键词
ProposalsFeature extractionTask analysisLocation awarenessNetwork architectureConvolutionAggregatesTemporal-aware relation and attention networktemporal self-attention modulemultiple temporal aggregation modulegraph relation moduletemporal action localization
相关
加载中…
  • Relation Attention for Temporal Action Localization
    Chen, Peihao; Gan, Chuang; Shen, Guangyao; Huang, Wenbing; Zeng, Runhao; Tan, Mingkui*IEEE TRANSACTIONS ON MULTIMEDIA, 2020, 22(10): 2723-2733.被引 40
  • A Multitemporal Scale and Spatial-Temporal Transformer Network for Temporal Action Localization
    Gao, Zan; Cui, Xinglei; Zhuo, Tao*; Cheng, Zhiyong; Liu, An-An; Wang, Meng; Chen, ShenyongIEEE Transactions on Human-Machine Systems, 2023, 53(3): 569-580.
  • Graph Convolutional Module for Temporal Action Localization in Videos
    Zeng, Runhao; Huang, Wenbing; Tan, Mingkui*; Rong, Yu; Zhao, Peilin; Huang, Junzhou; Gan, ChuangIEEE Transactions on Pattern Analysis and Machine Intelligence, 2022, 44(10): 6209-6223.被引 20
查看全部 →

发表信息

论文状态
公开发表
期刊
IEEE Transactions on Image Processing
发表日期
2022-07-08
卷期
第 31 卷
页码
4746-4760
DOI
10.1109/TIP.2022.3182866
语言
ENGLISH
期刊等级
1区
成果收录
SCIE
资助标注
National Natural Science Foundation of China [61872270, 62020106004, 92048301, 62171145]; Young Creative Team in universities of Shandong Province [2020KJN012]; Jinan 20 projects in universities [2020GXRC040, 2018GXRC014]; New Artificial Intelligence Project toward the Integration of Education and Industry in Qilu University of Technology [2020KJC-JC01]

作者

  • Z

    Zhao, Yibo (第一作者)

    tianjin univ technol

  • Z

    Zhang, Hua

    tianjin univ technol

查看全部 8 位作者收起作者
  • G

    Gao, Zan (通讯)

    shandong acad sci

  • G

    Guan, Weili

  • N

    Nie, Jie (通讯)

    ocean univ china

  • L

    Liu, Anan

    tianjin univ

  • W

    Wang, Meng

  • C

    Chen, Shengyong

    tianjin univ technol

登录解锁更多功能

  • 收藏这篇,随时在“我的 · 收藏”找回
  • 认领你的成果,生成推广素材
  • 关注作者获取最新成果
  • 加入项目组、协同写作
注册 / 登录

产品服务

  • 科研之友
  • 创新城
  • 科创云

服务支持

  • 帮助中心
  • 隐私政策
  • 服务条款

联系方式

在线客服:【】
客服热线:400-1616-289
电子邮箱:support@scholarmate.com

关注或下载科研之友

微信二维码
微信公众号
客户端下载二维码
下载客户端
科研成果科研人员科研机构科研动态爱瑞思软件

©2026 深圳市科研之友网络服务有限公司

公安备案图标粤公网安备 44030502000213
粤ICP备 16046710 号粤B2-20110417