ScholarMate
English简体中文繁體中文
客服热线:400-1616-289
登录注册
期刊论文

Multi-Relations Aware Network for In-the-Wild Facial Expression Recognition

Chen, Dongliang; Wen, Guihua*; Li, Huihui; Chen, Rui; Li, Cheng广东技术师范学院; 哈尔滨工程大学
IEEE Transactions on Circuits and Systems for Video Technology2023-8DOI: 10.1109/TCSVT.2023.3234312
6被引6阅读
引用收藏
分享

摘要

Facial expression recognition (FER) becomes more challenging in the wild due to unconstrained conditions, such as the different illumination, pose changes, and occlusion of the face. Current FER methods deploy the attention mechanism in deep neural networks to improve the performance. However, these models only capture the limited attention features and relationships. Thus this paper proposes a novel FER framework called multi-relations aware network (MRAN), which can focus on global and local attention features and learn the multi-level relationships among local regions, between global-local features and among different samples, to obtain efficient emotional features. Specifically, our method first imposes the spatial attention on both the whole face and local regions to simultaneously learn the global and local salient features. After that, a region relation transformer is deployed to capture the internal structure among local facial regions, and a global-local relation transformer is designed to learn the fusion relations between global features and local features for different facial expressions. Subsequently, a sample relation transformer is deployed to focus on intrinsic similarity relationship among training samples, which promotes invariant feature learning for each expression. Finally, a joint optimization strategy is designed to efficiently optimize the model. The conducted experimental results on in-the-wild databases show that our method obtains the superior performance compared to some state-of-the-art models.

学科与关键词

关键词
Deep neural networkfacial expression recognitionattention mechanismmulti-relations learningtransformer
相关
加载中…
  • Two-stream Global-Guided Attention Network for Facial Expression Recognition
    Wen, Yaoli; Xu, Xiangmin*; Liu, Fang; Xing, Xiaofen; Wang, Lin16th IEEE International Conference on Automatic Face and Gesture Recognition (FG), TIH iHub Drishti, ELECTR NETWORK, 2021-12-15 To 2021-12-18.
  • Facial Expression Recognition Based on Fine-Tuned Channel-Spatial Attention Transformer
    Yao, Huang; Yang, Xiaomeng; Chen, Di; Wang, Zhao; Tian, Yuan*SENSORS, 2023, 23(15): 6799.被引 1
  • Regional Self-Attention Convolutional Neural Network for Facial Expression Recognition
    Zhou, Lifang*; Wang, Yi; Lei, Bangjun; Yang, WeibinINTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2022, 36(08): 2256013.被引 2
查看全部 →

发表信息

论文状态
公开发表
期刊
IEEE Transactions on Circuits and Systems for Video Technology
发表日期
2023-08
卷期
第 33 卷, 第 8 期
页码
3848-3859
DOI
10.1109/TCSVT.2023.3234312
语言
ENGLISH
成果收录
SCIE
资助标注
China National Science Foundation [62176095, 62006049, 61976092]; Guangdong Province Key Area Research and Development Plan [2020B1111120001]

作者

  • C

    Chen, Dongliang (第一作者)

    south china univ technol

  • W

    Wen, Guihua (通讯)

    south china univ technol

查看全部 5 位作者收起作者
  • L

    Li, Huihui

    guangdong polytech normal univ

  • C

    Chen, Rui

  • L

    Li, Cheng

登录解锁更多功能

  • 收藏这篇,随时在“我的 · 收藏”找回
  • 认领你的成果,生成推广素材
  • 关注作者获取最新成果
  • 加入项目组、协同写作
注册 / 登录

产品服务

  • 科研之友
  • 创新城
  • 科创云

服务支持

  • 帮助中心
  • 隐私政策
  • 服务条款

联系方式

在线客服:【】
客服热线:400-1616-289
电子邮箱:support@scholarmate.com

关注或下载科研之友

微信二维码
微信公众号
客户端下载二维码
下载客户端
科研成果科研人员科研机构科研动态爱瑞思软件

©2026 深圳市科研之友网络服务有限公司

公安备案图标粤公网安备 44030502000213
粤ICP备 16046710 号粤B2-20110417