摘要
Facial emotional classification (FEC) is a challenging issue in human-robot interaction. In this study, we proposed a novel FEC network with feature similarity-based soft label training. The proposed model aims at addressing the problems of occlusion and label ambiguity. It argues that the mouth region is very important for FEC task. To this end, all the facial emotional images are firstly used to extract the infrared facial features by the trained ResNet networks. The facial features similarities are computed by the cosine function. The emotional labels can be constructed by the similarities values. Then, Kullback-Leibler distance is employed to measure the difference between the groundtruth label and predicted label. Extension experimental results on two public datasets demonstrate that the proposed model can obtain state-of-the-art performance compared with the existing studies. Furthermore, we have applied proposed model on the assisted driving scene and human robot interaction environment.
学科与关键词
- Facial expression recognition method with multi-label distribution learning for non-verbal behavior understanding in the classroomLiu, Tingting; Wang, Jixin; Yang, Bing*; Wang, XuanInfrared Physics and Technology, 2021, 112: 103594.被引 39
- A Facial Expression Emotion Recognition Based Human-robot Interaction SystemLiu, Zhentao; Wu, Min*; Cao, Weihua; Chen, Luefeng; Xu, Jianping; Zhang, Ri; Zhou, Mengtian; Mao, JunweiIEEE/CAA Journal of Automatica Sinica, 2017, 4(4): 668-676.被引 106
- Toward Facial Expression Recognition in the Wild via Noise-Tolerant NetworkGu, Yu; Yan, Huan*; Zhang, Xiang; Wang, Yantong; Ji, Yusheng; Ren, FujiIEEE Transactions on Circuits and Systems for Video Technology, 2023, 33(5): 2033-2047.
