ScholarMate
English简体中文繁體中文
客服热线:400-1616-289
登录注册
期刊论文

Video anomaly detection with spatio-temporal dissociation

Chang, Yunpeng; Tu, Zhigang*; Xie, Wei; Luo, Bin; Zhang, Shifu; Sui, Haigang; Yuan, Junsong武汉大学
Pattern Recognition2022-2DOI: 10.1016/j.patcog.2021.108213
64被引5阅读
引用收藏
分享

摘要

Anomaly detection in videos remains a challenging task due to the ambiguous definition of anomaly and the complexity of visual scenes from real video data. Different from the previous work which utilizes reconstruction or prediction as an auxiliary task to learn the temporal regularity, in this work, we explore a novel convolution autoencoder architecture that can dissociate the spatio-temporal representation to separately capture the spatial and the temporal information, since abnormal events are usually different from the normality in appearance and/or motion behavior. Specifically, the spatial autoencoder models the normality on the appearance feature space by learning to reconstruct the input of the first individual frame (FIF), while the temporal part takes the first four consecutive frames as the input and the RGB difference as the output to simulate the motion of optical flow in an efficient way. The abnormal events, which are irregular in appearance or in motion behavior, lead to a large reconstruction error. To improve detection performance on fast moving outliers, we exploit a variance-based attention module and insert it into the motion autoencoder to highlight large movement areas. In addition, we propose a deep K means cluster strategy to force the spatial and the motion encoder to extract a compact representation. Extensive experiments on some publicly available datasets have demonstrated the effectiveness of our method which achieves the state-of-the-art performance. The code is publicly released at the link1.

学科与关键词

关键词
Video anomaly detectionSpatio-temporal dissociationSimulate motion of optical flowDeep K-means cluster
相关
加载中…
  • LEARNING TASK-SPECIFIC REPRESENTATION FOR VIDEO ANOMALY DETECTION WITH SPATIAL-TEMPORAL ATTENTION
    Liu, Yang; Liu, Jing; Zhu, Xiaoguang; Wei, Donglai; Huang, Xiaohong; Song, Liang*47th IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Singapore, SINGAPORE, 2022-05-22 To 2022-05-27.被引 10
  • Multi-Encoder Towards Effective Anomaly Detection in Videos
    Fang, Zhiwen; Zhou, Joey Tianyi*; Xiao, Yang; Li, Yanan; Yang, FengIEEE TRANSACTIONS ON MULTIMEDIA, 2021, 23: 4106-4116.被引 18
  • A Hybrid Video Anomaly Detection Framework via Memory-Augmented Flow Reconstruction and Flow-Guided Frame Prediction
    Liu, Zhian; Nie, Yongwei*; Long, Chengjiang; Zhang, Qing; Li, Guiqing18th IEEE/CVF International Conference on Computer Vision (ICCV), ELECTR NETWORK, 2021-10-11 To 2021-10-17.被引 66
查看全部 →

发表信息

论文状态
公开发表
期刊
Pattern Recognition
发表日期
2022-02
卷期
第 122 卷
页码
108213
DOI
10.1016/j.patcog.2021.108213
语言
ENGLISH
期刊等级
1区
成果收录
SCIE
资助标注
National Natural Science Foundation of China [62106177]; supercomputing system in the Super-computing Center of Wuhan University; Wuhan University-Infinova [2019010019]

作者

  • C

    Chang, Yunpeng (第一作者)

    wuhan univ

  • T

    Tu, Zhigang (通讯)

    wuhan univ

查看全部 7 位作者收起作者
  • X

    Xie, Wei

    cent china normal univ

  • L

    Luo, Bin

    wuhan univ

  • Z

    Zhang, Shifu

  • S

    Sui, Haigang

    wuhan univ

  • Y

    Yuan, Junsong

登录解锁更多功能

  • 收藏这篇,随时在“我的 · 收藏”找回
  • 认领你的成果,生成推广素材
  • 关注作者获取最新成果
  • 加入项目组、协同写作
注册 / 登录

产品服务

  • 科研之友
  • 创新城
  • 科创云

服务支持

  • 帮助中心
  • 隐私政策
  • 服务条款

联系方式

在线客服:【】
客服热线:400-1616-289
电子邮箱:support@scholarmate.com

关注或下载科研之友

微信二维码
微信公众号
客户端下载二维码
下载客户端
科研成果科研人员科研机构科研动态爱瑞思软件

©2026 深圳市科研之友网络服务有限公司

公安备案图标粤公网安备 44030502000213
粤ICP备 16046710 号粤B2-20110417