摘要
Facial expression recognition (FER) has been a challenging task in the field of artificial intelligence. In this paper, we propose a novel model, named regional self-attention convolutional neural network (RSACNN), for FER. Different from the previous methods, RSACNN makes full use of the facial texture of expression salient region, so yields a robust feature representation for FER. The proposed model contains two novel parts: regional local multiple pattern (RLMP) based on the improved K-means algorithm and the regional self-attention module (RSAM). First, RLMP uses the improved K-means algorithm to dynamically cluster the pixels to ensure the robustness of texture features with expression salient variation. Besides, the texture description is enhanced by extending the binary pattern to the multiple patterns and integrating the information of gray difference between pixels in the region. Next, RSAM can adaptively form weights for each region through the self-attention mechanism, and use rank regularization loss (RRLoss) to constrain the weights of different regions. By jointly combining RLMP and RSAM, RSACNN can effectively enhance the feature representation of expression salient regions, so that the performance of expression recognition can be improved. Extensive experiments on public datasets, i.e. CK+, Oulu-CASIA, Fer2013 and SFEW, prove the superiority of our method over state-of-the-art approaches.
学科与关键词
- Multi-Relations Aware Network for In-the-Wild Facial Expression RecognitionChen, Dongliang; Wen, Guihua*; Li, Huihui; Chen, Rui; Li, ChengIEEE Transactions on Circuits and Systems for Video Technology, 2023, 33(8): 3848-3859.被引 6
- A Cascade Attention Based Facial Expression Recognition Network by Fusing Multi-Scale Spatio-Temporal FeaturesZhu, Xiaoliang; He, Zili; Zhao, Liang*; Dai, Zhicheng*; Yang, QiaolaiSENSORS, 2022, 22(4): 1350.被引 11
- Self-Difference Convolutional Neural Network for Facial Expression RecognitionLiu, Leyuan; Jiang, Rubin; Huo, Jiao; Chen, Jingying*SENSORS, 2021, 21(6): 2250.被引 6
