ScholarMate
English简体中文繁體中文
客服热线:400-1616-289
登录注册
期刊论文

Toward Children's Empathy Ability Analysis: Joint Facial Expression Recognition and Intensity Estimation Using Label Distribution Learning

Chen, Jingying; Guo, Chen; Xu, Ruyi; Zhang, Kun*; Yang, Zongkai; Liu, Honghaicent china normal univ; harbin inst technol shenzhen
IEEE Transactions on Industrial Informatics2022-1DOI: 10.1109/TII.2021.3075989
10被引6阅读
引用收藏
分享

摘要

Empathy ability is one of the most important social communication skills in early childhood development. To analyze the children's empathy ability, facial expression analysis (FEA) is an effective way due to its ability to understand children's emotional states. Previous works mainly focus on recognizing the facial expression categories yet fail to estimate expression intensity, the latter of which is more important for fine-grained emotion analysis. To this end, this article first proposes to analyze children's empathy ability with both the categories and the intensities of facial expressions. A novel FEA method based on intensity label distribution learning is presented, which aims to recognize expression categories and estimate their intensity levels in an end-to-end framework. First, the intensity label distribution is generated for each frame in the expression sequence using a linear interpolation estimation and a Gaussian function to address the lack of reasonable annotations for expression intensity. Then, the extended intensity label distribution is presented to automatically encode the expression intensity in a multidimensional expression space, which aims to integrate the expression recognition and intensity estimation into a unified framework as well as boost the expression recognition performance by suppressing the variations in appearance caused by intensity and by emphasizing those variations among weak expressions. Finally, a Siamese-like convolutional neural network is presented to learn the expression model from a pair of frames that includes an expressive frame and its corresponding neutral frame using the extended intensity label distribution as the supervised information, thus effectively eliminating the expression-unrelated information's influence on FEA. Numerous experiments validate that the proposed method is promising in analysis of the differences in empathy ability between typically developing children and children with autism spectrum disorder.

学科与关键词

关键词
Face recognitionEstimationTask analysisInterpolationAnnotationsPediatricsInformaticsEmpathy ability analyticsexpression intensity estimationfacial expression recognitionintensity label distributionSiamese-like convolutional neural network (CNN)
相关
加载中…
  • Ordinal information based facial expression intensity estimation for emotional interaction: a novel semi-supervised deep learning approach
    Xu, Ruyi; Han, Jiaxu; Chen, Jingying*Computing (Vienna/New York), 2022.被引 1
  • Design and application of facial expression analysis system in empathy ability of children with autism spectrum disorder
    Guo, Chen; Zhang, Kun*; Chen, Jingying; Xu, Ruyi; Gao, Lei16th Conference on Computer Science and Intelligence Systems (FedCSIS), ELECTR NETWORK, 2021-09-02 To 2021-09-05.被引 2
  • Facial expression intensity estimation using label-distribution-learning-enhanced ordinal regression
    Xu, Ruyi; Wang, Zhun; Chen, Jingying*; Zhou, LongpuMultimedia Systems, 2024, 30(1): 13.
查看全部 →

发表信息

论文状态
公开发表
期刊
IEEE Transactions on Industrial Informatics
发表日期
2022-01
卷期
第 18 卷, 第 1 期
页码
16-25
DOI
10.1109/TII.2021.3075989
语言
ENGLISH
期刊等级
1区
成果收录
SCIE
资助标注
National Natural ScienceFoundation of China [61807014, 61977027]; Hubei Province Technological Innovation Major Project [2019AAA044]; Fundamental Research Funds for the Central Universities [CCNU19QN039]; Research Funds of Central China Normal University from the Colleges' Basic Research and Operation of the Ministry of Education [CCNU19Z02002, CCNU18KFY02]

作者

  • C

    Chen, Jingying (第一作者)

    cent china normal univ

  • G

    Guo, Chen

    cent china normal univ

查看全部 6 位作者收起作者
  • X

    Xu, Ruyi

    cent china normal univ

  • Z

    Zhang, Kun (通讯)

    cent china normal univ

  • Y

    Yang, Zongkai

    cent china normal univ

  • L

    Liu, Honghai

    harbin inst technol shenzhen

登录解锁更多功能

  • 收藏这篇,随时在“我的 · 收藏”找回
  • 认领你的成果,生成推广素材
  • 关注作者获取最新成果
  • 加入项目组、协同写作
注册 / 登录

产品服务

  • 科研之友
  • 创新城
  • 科创云

服务支持

  • 帮助中心
  • 隐私政策
  • 服务条款

联系方式

在线客服:【】
客服热线:400-1616-289
电子邮箱:support@scholarmate.com

关注或下载科研之友

微信二维码
微信公众号
客户端下载二维码
下载客户端
科研成果科研人员科研机构科研动态爱瑞思软件

©2026 深圳市科研之友网络服务有限公司

公安备案图标粤公网安备 44030502000213
粤ICP备 16046710 号粤B2-20110417