Knowledge Commons of Institute of Automation,CAS
Medical Term and Status Generation From Chinese Clinical Dialogue With Multi-Granularity Transformer | |
Li, Mei1,2![]() ![]() ![]() ![]() ![]() ![]() | |
发表期刊 | IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING
![]() |
ISSN | 2329-9290 |
2021 | |
卷号 | 29页码:3362-3374 |
摘要 | This paper describes a generative model for extracting medical terms and their status from Chinese medical dialogues. Notably, the extracted semantic information is particularly important to downstream tasks like automatic medical scribe and automatic diagnosis systems. However, how to effectively leverage dialogue context to generate medical terms and their corresponding status accurately remains less explored. Existing generative approaches treat dialogue text as a single continuous text, ignoring conversational characteristics like colloquialism, redundancy and interactions. Between the doctor and the patient, a variety of colloquial medical information is frequently discussed. Each speaker (doctor and patient) plays a specific role in the interaction's goals. As a result, the importance of role information and interactions between utterances cannot be overstated. Furthermore, existing generative approaches only use character-level tokens, disregarding word-level tokens, which are the shortest meaningful utterances in Chinese. In this paper, we propose a Multi-granularity Transformer (MGT) model to enhance the dialogue context understanding from multi-granularity features. We incorporate word-level information by adapting a Lattice-based encoder with our proposed relative position encoding method. We further propose a Role Access Controlled Attention (RaCa) mechanism for introducing utterance-level interaction information. Experimental results on two benchmark datasets illustrate our model's validity and effectiveness, achieving state-of-the-art performance on both datasets. |
关键词 | Medical diagnostic imaging Transformers Task analysis Medical services Computational modeling Semantics Data mining Medical dialogue multi-granularity attention mechanism natural language understanding sequence to sequence learning |
DOI | 10.1109/TASLP.2021.3122301 |
收录类别 | SCI |
语种 | 英语 |
资助项目 | National Key R&D Program of China[2020AAA0108600] |
项目资助者 | National Key R&D Program of China |
WOS研究方向 | Acoustics ; Engineering |
WOS类目 | Acoustics ; Engineering, Electrical & Electronic |
WOS记录号 | WOS:000716689200004 |
出版者 | IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC |
七大方向——子方向分类 | 自然语言处理 |
引用统计 | |
文献类型 | 期刊论文 |
条目标识符 | http://ir.ia.ac.cn/handle/173211/46329 |
专题 | 多模态人工智能系统全国重点实验室_自然语言处理 |
通讯作者 | Zong, Chengqing |
作者单位 | 1.Chinese Acad Sci, Natl Lab Pattern Recognit, Inst Automat, Beijing 100190, Peoples R China 2.Univ Chinese Acad Sci CAS, Sch Artificial Intelligence, Beijing 100049, Peoples R China 3.Univ Chinese Acad Sci, Sch Artificial Intelligence, Beijing 100049, Peoples R China 4.Beijing Fanyu Technol Co Ltd, Fanyu AI Lab, Beijing, Peoples R China 5.CAS Ctr Excellence Brain Sci & Intelligence Techn, Shanghai 200031, Peoples R China |
第一作者单位 | 模式识别国家重点实验室 |
通讯作者单位 | 模式识别国家重点实验室 |
推荐引用方式 GB/T 7714 | Li, Mei,Xiang, Lu,Kang, Xiaomian,et al. Medical Term and Status Generation From Chinese Clinical Dialogue With Multi-Granularity Transformer[J]. IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING,2021,29:3362-3374. |
APA | Li, Mei,Xiang, Lu,Kang, Xiaomian,Zhao, Yang,Zhou, Yu,&Zong, Chengqing.(2021).Medical Term and Status Generation From Chinese Clinical Dialogue With Multi-Granularity Transformer.IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING,29,3362-3374. |
MLA | Li, Mei,et al."Medical Term and Status Generation From Chinese Clinical Dialogue With Multi-Granularity Transformer".IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING 29(2021):3362-3374. |
条目包含的文件 | 下载所有文件 | |||||
文件名称/大小 | 文献类型 | 版本类型 | 开放类型 | 使用许可 | ||
Medical_Term_and_Sta(3036KB) | 期刊论文 | 作者接受稿 | 开放获取 | CC BY-NC-SA | 浏览 下载 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论