摘要
Facial Expression Recognition (FER) has recently emerged as a crucial area in Human-Computer Interaction (HCI) system for understanding the user's inner state and intention. However, feature- and label-noise constitute the major challenge for FER in the wild due to the ambiguity of facial expressions worsened by low-quality images. To deal with this problem, in this paper, we propose a simple but effective Facial Expression Noise-tolerant Network (FENN) which explores the inter-class correlations for mitigating ambiguity that usually happens between morphologically similar classes. Specifically, FENN leverages a multivariate normal distribution to model such correlations at the final hidden layer of the neural network to suppress the heteroscedastic uncertainty caused by inter-class label noise. Furthermore, the discriminative ability of deep features is weakened by the subtle differences between expressions and the presence of feature noise. FENN utilizes a feature-noise mitigation module to extract compact intra-class feature representations under feature noise while preserving the intrinsic inter-class relationships. We conduct extensive experiments to evaluate the effectiveness of FENN on both original annotated images and synthetic noisy annotated images from RAF-DB, AffectNet, and FERPlus in-the-wild facial expression datasets. The results show that FENN significantly outperforms state-of-the-art FER methods.
学科与关键词
- MAN: Mining Ambiguity and Noise for Facial Expression Recognition in the WildZhang, Ziyang; Sun, Xiao*; Li, Jia; Wang, MengPATTERN RECOGNITION LETTERS, 2022, 164: 23-29.被引 3
- GCANet: Geometry cues-aware facial expression recognition based on graph convolutional networksWang, Shutong; Zhao, Anran; Lai, Chenghang; Zhang, Qi*; Li, Duantengchuan; Gao, Yihua; Dong, Liangshan; Wang, XiaoguangJournal of King Saud University-Computer and Information Sciences, 2023, 35(7): 101605.被引 4
- Multi-loss, feature fusion and improved top-two-voting ensemble for facial expression recognition in the wildZhou, Guangyao*; Xie, Yuanlun; Fu, Yiqin; Wang, ZhaokunNeural Networks, 2025, 183: 106937.
