摘要
Facial expression is the main approach for humans to express their emotions. It is the temporal-spatial information that can be recognized by computers. In this paper, three video-based models are proposed for the facial expression recognition system (FERS). First, a differential geometric fusion network (DGFN) is proposed, which utilizes the technique of the handcrafted feature for traditional machine learning. The static geometric feature in the DGFN, which is based on the critical regions of psychology and the rules of physiology, is converted into the differential geometric feature by the geometric fusion model. Then deep-facial-sequential network (DFSN) is designed based on a multi-dimensional convolutional neural network (CNN). Finally, the DFSN-I is proposed, which is the combination of the DGFN and the DFSN taking advantages of both to achieve better performance. The experimental result shows that the combination of the handcrafted feature with prior experience and the auto-extracted feature provides better performance. It also shows that our DFSN and DFSN-I outperform the state-of-the-art methods on the Oulu-CASIA data set and achieve almost the best performance on CK compared with the other video-based methods.
学科与关键词
- SG-DSN: A Semantic Graph-based Dual-Stream Network for facial expression recognitionLiu, Yang; Zhang, Xingming*; Zhou, Jinzhao; Fu, LunkaiNEUROCOMPUTING, 2021, 462: 320-330.被引 13
- Human-Computer Interaction Using Deep Fusion Model-Based Facial Expression Recognition SystemUmer, Saiyed*; Rout, Ranjeet Kumar; Tiwari, Shailendra; AlZubi, Ahmad Ali; Alanazi, Jazem Mutared; Yurii, KulakovCMES-COMPUTER MODELING IN ENGINEERING & SCIENCES, 2023, 135(2): 1165-1185.被引 2
- Recognition of facial expressions based on salient geometric features and support vector machinesGhimire, Deepak; Lee, Joonwhoan*; Li, Ze-Nian; Jeong, SunghwanMULTIMEDIA TOOLS AND APPLICATIONS, 2017, 76(6): 7921-7946.被引 43
