ScholarMate
English简体中文繁體中文
客服热线:400-1616-289
登录注册
期刊论文

TC-Net: A Transformer Capsule Network for EEG-based emotion recognition

Wei, Yi; Liu, Yu*; Li, Chang; Cheng, Juan; Song, Rencheng; Chen, Xuny
Computers in Biology and Medicine2023-1DOI: 10.1016/j.compbiomed.2022.106463
17被引7阅读
引用收藏
分享

摘要

Deep learning has recently achieved remarkable success in emotion recognition based on Electroencephalogram (EEG), in which convolutional neural networks (CNNs) are the mostly used models. However, due to the local feature learning mechanism, CNNs have difficulty in capturing the global contextual information involving temporal domain, frequency domain, intra-channel and inter-channel. In this paper, we propose a Transformer Capsule Network (TC-Net), which mainly contains an EEG Transformer module to extract EEG features and an Emotion Capsule module to refine the features and classify the emotion states. In the EEG Transformer module, EEG signals are partitioned into non-overlapping windows. A Transformer block is adopted to capture global features among different windows, and we propose a novel patch merging strategy named EEG-PatchMerging (EEG-PM) to better extract local features. In the Emotion Capsule module, each channel of the EEG feature maps is encoded into a capsule to better characterize the spatial relationships among multiple features. Experimental results on two popular datasets (i.e., DEAP and DREAMER) demonstrate that the proposed method achieves the state-of-the-art performance in the subject-dependent scenario. Specifically, on DEAP (DREAMER), our TC-Net achieves the average accuracies of 98.76% (98.59%), 98.81% (98.61%) and 98.82% (98.67%) at valence, arousal and dominance dimensions, respectively. Moreover, the proposed TC-Net also shows high effectiveness in multi-state emotion recognition tasks using the popular VA and VAD models. The main limitation of the proposed model is that it tends to obtain relatively low performance in the cross-subject recognition task, which is worthy of further study in the future.

学科与关键词

关键词
Electroencephalogram (EEG)Emotion recognitionTransformerCapsule network
相关
加载中…

文献加载失败,请重试

重试

发表信息

论文状态
公开发表
期刊
Computers in Biology and Medicine
发表日期
2023-01
卷期
第 152 卷
页码
106463
DOI
10.1016/j.compbiomed.2022.106463
语言
ENGLISH
成果收录
SCIE
资助标注
National Key Research and Develop-ment Program of China [2019YFA0706203]; National Natural Science Foundation of China [62176081, 41901350, 32271431, 61922075, 62171176, 62271186]; National Defense Basic Sci-entific Research Program of China [JCKY2019548B001]; Fundamental Research Funds for the Central Universities [JZ2020HGPA0111, JZ2021HGTB0078, JZ2021HGPA0061]

作者

  • W

    Wei, Yi (第一作者)

  • L

    Liu, Yu (通讯)

查看全部 6 位作者收起作者
  • L

    Li, Chang

  • C

    Cheng, Juan

  • S

    Song, Rencheng

  • C

    Chen, Xun

    univ sci & technol china

登录解锁更多功能

  • 收藏这篇,随时在“我的 · 收藏”找回
  • 认领你的成果,生成推广素材
  • 关注作者获取最新成果
  • 加入项目组、协同写作
注册 / 登录

产品服务

  • 科研之友
  • 创新城
  • 科创云

服务支持

  • 帮助中心
  • 隐私政策
  • 服务条款

联系方式

在线客服:【】
客服热线:400-1616-289
电子邮箱:support@scholarmate.com

关注或下载科研之友

微信二维码
微信公众号
客户端下载二维码
下载客户端
科研成果科研人员科研机构科研动态爱瑞思软件

©2026 深圳市科研之友网络服务有限公司

公安备案图标粤公网安备 44030502000213
粤ICP备 16046710 号粤B2-20110417