Chinese Medical Named Entity Recognition Based on Gated Attention Unit

Wu Xiao-ling; Chen Xiang-wang; Zhan Wen-tao; Ling Jie

doi:10.12052/gdutxb.230065

English Version Journal Login

您当前的位置：

首页 >

文章列表页 >

Chinese Medical Named Entity Recognition Based on Gated Attention Unit

更新时间：2026-05-27

- Chinese Medical Named Entity Recognition Based on Gated Attention Unit
- Vol. 40, Issue 6, Pages: 176-184(2023)
- 作者机构：
  
  广东工业大学计算机学院,广东,广州,510006
- 作者简介：
- 基金信息：
- DOI：10.12052/gdutxb.230065
  CLC： TP391.41
- Online First：25 November 2023，
  
  Published：2023
- 稿件说明：
移动端阅览
吴晓鸰, 陈祥旺, 占文韬, 凌捷. 基于门控注意力单元的中文医学命名实体识别[J]. 广东工业大学学报, 2023, 40(6): 176-184.

Wu Xiao-ling, Chen Xiang-wang, Zhan Wen-tao, et al. Chinese Medical Named Entity Recognition Based on Gated Attention Unit[J]. 2023, 40(6): 176-184.
吴晓鸰, 陈祥旺, 占文韬, 凌捷. 基于门控注意力单元的中文医学命名实体识别[J]. 广东工业大学学报, 2023, 40(6): 176-184. DOI： 10.12052/gdutxb.230065.

Wu Xiao-ling, Chen Xiang-wang, Zhan Wen-tao, et al. Chinese Medical Named Entity Recognition Based on Gated Attention Unit[J]. 2023, 40(6): 176-184. DOI： 10.12052/gdutxb.230065.

摘要

医学命名实体识别任务是对电子病历中的医学实体进行自动识别和分类，对于下游任务例如信息检索、知识图谱等有着十分重要的作用。现有的方法忽略了实体间的依赖性，因此，本文提出了一种基于门控注意力单元的模型，首先利用预训练模型MC-BERT捕捉上下文语境信息，再利用交叉注意力和门控注意力单元提高实体查询和上下文语义之间的交互性，并提取实体间的依赖关系和关联性，最后，利用二分图的匹配算法，计算模型训练中的损失。本文在CMeEE、CMQNN和MSRA数据集上进行了实验，实验结果表明本文模型在3个数据集上的

值分别达到了70.74%，96.92%和95.53%，优于其他相关模型，证明了本文模型在中文医学命名实体识别任务上的有效性。

Abstract

The medical named entity recognition aims to automatically identify and classify medical entities in electronic medical records

which plays a very important role in downstream tasks such as information retrieval and knowledge graph. Existing methods usually ignore the dependencies between entities. To address this

this paper proposes a gated attention unit-based model for Chinese medical named entity recognition. First

the proposed model uses the pre-training model MC-BERT to capture contextual information. Then

it uses the cross-attention and gated attention unit to enhance the interaction between entity query and contextual semantics

and further extract the dependency and corre

lation between entities. Finally

the proposed model uses the matching algorithm of bipartite graph to calculate the loss. This paper conducted experiments on three datasets

including the CMeEE

CMQNN

and MSRA. The experimental results show that the

values of the proposed model on the three datasets are 70.74%

96.92%

and 95.53%

respectively

which outperforms other related models

demonstrating the effectiveness of the proposed model in Chinese medical named entity recognition task.

关键词

Keywords

references

SU P Y, HUANG J W. The application of BIM technology in the field of engineering cost based on knowledge graph [J]. Journal of Guangdong University of Technology, 2023, 40(2): 103-110.

CAO Z X, WU X L, LUO X W, et al . Helmet wearing detection algorithm integrating transfer learning and YOLOv5 [J ] . Journal of Guangdong University of Technology, 2023, 40(4): 67-76.

WU S H, SHEN Y L, TAN Z Q, et al. Propose-and-refine: a two-stage set prediction network for nested named entity recognition[C ] //Proceedings of the 31th International Joint Conference on Artificial Intelligence. Montreal: IJCAI, 2022: 4418-4424.

WANG B L, LU W. Combining spans into entities: a neural two-stage approach for recognizing discontiguous entities[C]//Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the Ninth International Joint Conference on Natural Language Processing. Hong Kong: ACL, 2019: 6217-6225.

LI F, LIN Z C, ZHANG M S, et al . A span-based model for joint overlapped and discontinuous named entity recognition[C ] //Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) . Bangkok: ACL, 2021: 4814-4828.

GU Y J, QU X Y, WANG Z F, et al . Delving deep into regularity: a simple but effective method for Chinese named entity recognition[C ] //Findings of the Association for Computational Linguistics: NAACL 2022. Seattle: ACL, 2022: 1863-1873.

LUAN Y, WADDEN D, HE L H, et al . A general framework for information extraction using dynamic span graphs[C ] //Proceedings of the 2019 Conference of the North American Chapter of the ACL. Florence: ACL, 2019: 3036-3046.

YU J T, BOHNET B, POESIO M. Named entity recognition as dependency parsing[C]//Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics. Seattle: ACL, 2020: 6470-6476.

WANG Q, ZHOU Y M, RUAN T, et al . Incorporating dictionaries into deep neural networks for the Chinese clinical named entity recognition [J ] . Journal of Biomedical Informatics, 2019, 92: 103133.

LI X Y, ZHANG H, ZHOU X H. Chinese clinical named entity recognition with variant neural structures based on BERT methods [J]. Journal of Biomedical Informatics, 2020, 107: 103422.

LI X Y, FENG J R, MENG Y X, et al . A unified MRC framework for named entity recognition[C ] //Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics. Seattle: ACL, 2020: 5849-5859.

PAN Y, XIN C, SUN Z Y, et al. Enhanced language representation with label knowledge for span extraction[C ] //Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing. Punta Cana: ACL, 2021: 4623-4635.

HANG Y, GUI T, DAI J Q, et al. A unified generative framework for various NER subtasks[C ] //Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) . Bangkok: ACL, 2021: 5808-5822.

SHEN Y L, WANG X B, TAN Z Q, et al. Parallel instance query network for named entity recognition[C ] //Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) . Dublin: ACL, 2022: 947-961.

LI X N, YAN H, QIU X P, et al . FLAT: Chinese NER using flat-lattice transformer[C ] // Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics. Seattle: ACL, 2020: 6836-6842.

CHEN M, LIU R, ZHANG Y. Chinese medical entity recognition based on multiple attention mechanism [J]. Computer Engineering, 2023, 49(6): 314-320.

LIANG Z Q, WANG D, ZHU H, et al . A research on text information extraction from annual report based on domain ontology [J ] . Journal of Guangdong University of Technology, 2017, 34(3): 89-95.

LIU S Y, DUAN J W, GONG F, et al. Fusing label relations for Chinese EMR named entity recognition with machine reading comprehension[C ] //18th International Symposium on Bioinformatics Research and Applications. Berlin: Springer, 2023: 41-51.

ZHAO P, DOU Q S, TANG H L, et al . Attention adaptive model with word information embedding for named entity recognition [J ] . Computer Engineering and Applications, 2023(8): 167-174.

WU S, SONG X N, FENG Z H. MECT: multi-metadata embedding based cross-transformer for Chinese named entity recognition[C]//Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) . Bangkok: ACL, 2021: 1529-1539.

XUE M G, YU B W, LIU T W, et al . Porous lattice transformer encoder for Chinese NER[C ] //Proceedings of the 28th International Conference on Computational Linguistics. Barcelona: ICCL, 2020: 3831-3841.

MA R T, PENG M L, ZHANG Q, et al . Simplify the usage of lexicon in Chinese NER[C ] //Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics. Seattle: ACL, 2020: 5951-5960.

Views

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Speaker-Aware Cross Attention Speaker Extraction Network

SCA-YOLO: Real-time Target Detection Based on Deformable Convolution and Context-aware Attention

Bimodal Iterative Cross-attention Fusion Ensemble Framework

A Study of Power Quality Regulation Strategies of Energy Storage Converters

Robust Design for Artificial Noise-assisted UAV Terahertz Secure Communication

Related Author

Li Zhuo-zhang

Xu Bo-yan

Cai Rui-chu

Hao Zhi-feng

Related Institution

College of Science, Shantou University

AI问答

⁰