ScholarMate
English简体中文繁體中文
客服热线:400-1616-289
登录注册
期刊论文

Named entity recognition of Chinese electronic medical records based on a hybrid neural network and medical MC-BERT

Chen, Peng; Zhang, Meng; Yu, Xiaosheng; Li, Songpu*china three gorges univ
BMC Medical Informatics and Decision Making2022-12-1DOI: 10.1186/s12911-022-02059-2
5被引12阅读
引用收藏
分享

摘要

Background: Named entity recognition (NER) of electronic medical records is an important task in clinical medical research. Although deep learning combined with pretraining models performs well in recognizing entities in clinical texts, because Chinese electronic medical records have a special text structure and vocabulary distribution, general pretraining models cannot effectively incorporate entities and medical domain knowledge into representation learning; separate deep network models lack the ability to fully extract rich features in complex texts, which negatively affects the named entity recognition of electronic medical records. Methods: To better represent electronic medical record text, we extract the text's local features and multilevel sequence interaction information to improve the effectiveness of electronic medical record named entity recognition. This paper proposes a hybrid neural network model based on medical MC-BERT, namely, the MC-BERT + BiLSTM + CNN + MHA + CRF model. First, MC-BERT is used as the word embedding model of the text to obtain the word vector, and then BiLSTM and CNN obtain the feature information of the forward and backward directions of the word vector and the local context to obtain the corresponding feature vector. After merging the two feature vectors, they are sent to multihead self-attention (MHA) to obtain multilevel semantic features, and finally, CRF is used to decode the features and predict the label sequence. Results: The experiments show that the F1 values of our proposed hybrid neural network model based on MC-BERT reach 94.22%, 86.47%, and 92.28% on the CCKS-2017, CCKS-2019 and cEHRNER datasets, respectively. Compared with the general-domain BERT-based BiLSTM + CRF, our F1 values increased by 0.89%, 1.65% and 2.63%. Finally, we analyzed the effect of an unbalanced number of entities in the electronic medical records on the results of the NER experiment.

学科与关键词

关键词
Named entity recognitionBERT modelChinese electronic medical recordHybrid neural network
相关
加载中…

文献加载失败,请重试

重试

发表信息

论文状态
公开发表
期刊
BMC Medical Informatics and Decision Making
发表日期
2022-12-01
卷期
第 22 卷, 第 1 期
页码
315
DOI
10.1186/s12911-022-02059-2
语言
ENGLISH
期刊等级
3区
成果收录
SCIE
资助标注
National Key Research and Development Program of China; [2016YFC0802500]

作者

  • C

    Chen, Peng (第一作者)

    china three gorges univ

  • Z

    Zhang, Meng

    china three gorges univ

查看全部 4 位作者收起作者
  • Y

    Yu, Xiaosheng

    china three gorges univ

  • L

    Li, Songpu (通讯)

    china three gorges univ

登录解锁更多功能

  • 收藏这篇,随时在“我的 · 收藏”找回
  • 认领你的成果,生成推广素材
  • 关注作者获取最新成果
  • 加入项目组、协同写作
注册 / 登录

产品服务

  • 科研之友
  • 创新城
  • 科创云

服务支持

  • 帮助中心
  • 隐私政策
  • 服务条款

联系方式

在线客服:【】
客服热线:400-1616-289
电子邮箱:support@scholarmate.com

关注或下载科研之友

微信二维码
微信公众号
客户端下载二维码
下载客户端
科研成果科研人员科研机构科研动态爱瑞思软件

©2026 深圳市科研之友网络服务有限公司

公安备案图标粤公网安备 44030502000213
粤ICP备 16046710 号粤B2-20110417