ScholarMate
English简体中文繁體中文
客服热线:400-1616-289
登录注册
期刊论文

Multi-loss, feature fusion and improved top-two-voting ensemble for facial expression recognition in the wild

Zhou, Guangyao*; Xie, Yuanlun; Fu, Yiqin; Wang, Zhaokun电子科技大学; 西南交通大学
Neural Networks2025-3DOI: 10.1016/j.neunet.2024.106937
1阅读
引用收藏
分享

摘要

Facial expression recognition (FER) in the wild is a challenging pattern recognition task affected by the images' low quality and has attracted broad interest in computer vision. Existing FER methods failed to obtain sufficient accuracy to support the practical applications, especially in scenarios with low fault tolerance, which limits the adaptability of FER. Targeting exploring the possibility of further improving the accuracy of FER in the wild, this paper proposes a novel single model named R18+FAML and an ensemble model named R18+FAMLFGA-T2V, which applies intra-feature fusion within a single network, feature fusion among multiple networks, and the ensemble decision strategy. Based on the backbone of ResNet18 (R18), R18+FAML combines internal feature fusion and three attention blocks, as well as uses multiple loss functions (FAML) to improve the diversity of the feature extraction. To effectively integrate feature extractors from multiple networks, we propose feature fusion among networks based on the genetic algorithm (FGA). Comprehensively considering and utilizing more classification information, we propose an ensemble strategy, i.e., the improved top-two-voting (T2V) of multiple networks with the same structure. Combining the above strategies, R18+FAML-FGA-T2V can focus on the main expression-aware areas by integrating interest areas of multiple networks. From experiments on three challenging FER datasets in the wild including RAF-DB, AffectNet-8 and AffectNet-7, our single model R18+FAML and ensemble model R18+FAML-FGA-T2V achieve the accuracies of (90.32, 62.17, 65.83) and (91.59, 63.27, 66.63) % respectively, both achieving the state-of-the-art results.

学科与关键词

关键词
Facial expression recognitionFeature fusionEnsemble strategyDeep learningTop-two-voting
相关
加载中…

文献加载失败,请重试

重试

发表信息

论文状态
公开发表
期刊
Neural Networks
发表日期
2025-03
卷期
第 183 卷
页码
106937
DOI
10.1016/j.neunet.2024.106937
语言
ENGLISH
成果收录
SCIE
资助标注
Project of Key Research and Development Program of Sichuan Province, China [2021YFG0325]; Chengdu Science and Technology Project, China [2022-YF05-02014-SN]

作者

  • Z

    Zhou, Guangyao (通讯) (第一作者)

    southwest jiaotong univ

  • X

    Xie, Yuanlun

    univ elect sci & technol china

查看全部 4 位作者收起作者
  • F

    Fu, Yiqin

  • W

    Wang, Zhaokun

    univ elect sci & technol china

登录解锁更多功能

  • 收藏这篇,随时在“我的 · 收藏”找回
  • 认领你的成果,生成推广素材
  • 关注作者获取最新成果
  • 加入项目组、协同写作
注册 / 登录

产品服务

  • 科研之友
  • 创新城
  • 科创云

服务支持

  • 帮助中心
  • 隐私政策
  • 服务条款

联系方式

在线客服:【】
客服热线:400-1616-289
电子邮箱:support@scholarmate.com

关注或下载科研之友

微信二维码
微信公众号
客户端下载二维码
下载客户端
科研成果科研人员科研机构科研动态爱瑞思软件

©2026 深圳市科研之友网络服务有限公司

公安备案图标粤公网安备 44030502000213
粤ICP备 16046710 号粤B2-20110417