Institutional Repository of Chinese Acad Sci, Inst Automat, Natl Lab Pattern Recognit, Beijing 100190, Peoples R China
Heterogeneous Relational Graph Neural Networks with Adaptive Objective for End-to-End Task-Oriented Dialogue | |
Alternative Title | Heterogeneous Relational Graph Neural Networks with Adaptive Objective for End-to-End Task-Oriented Dialogue |
Liu, Qingbin1,2![]() ![]() ![]() ![]() ![]() ![]() | |
Source Publication | KNOWLEDGE-BASED SYSTEMS
![]() |
ISSN | 0950-7051 |
2021-09-05 | |
Volume | 227Issue:2021Pages:107186 |
Abstract | End-to-end task-oriented dialogue systems, which provide a natural and informative way for human- computer interaction, are gaining more and more attention. The main challenge of such dialogue systems is how to effectively incorporate external knowledge bases into the learning framework. However, existing approaches usually overlook the natural graph structure information in the knowledge base and the relevant information between the knowledge base and the dialogue history, which makes them deficient in handling the above challenge. Besides, existing methods ignore the entity imbalance problem and treat different entities in system responses indiscriminately, which limits the learning of hard target entities. To address the two challenges, we propose Heterogeneous Relational Graph Neural Networks with Adaptive Objective (HRGNN-AO) for end-to-end task-oriented dialogue systems. In the method, we explore effective heterogeneous relational graphs to jointly capture multi perspective graph structure information from the knowledge base and the dialogue history, which ultimately facilitates the generation of informative responses. Moreover, we design two components, shared-private parameterization and hierarchical attention mechanism, to solve the overfitting and confusion problems in the heterogeneous relational graph, respectively. To handle the entity imbalance problem, we propose an adaptive objective, which dynamically adjusts the weights of different target entities during the training process. The experimental results show that HRGNN-AO is effective in generating informative responses and outperforms state-of-the-art dialogue systems on the SMD and extended Multi-WOZ 2.1 datasets. (c) 2021 Elsevier B.V. All rights reserved. |
Keyword | End-to-end task-oriented dialogue Heterogeneous relational graph neural networks Shared-private parameterization Hierarchical attention mechanism Adaptive objective |
DOI | 10.1016/j.knosys.2021.107186 |
Indexed By | SCI |
Language | 英语 |
Funding Project | National Key Research and Development Program of China[2020AAA0106400] ; National Natural Science Foundation of China[61922085] ; National Natural Science Foundation of China[61976211] ; Beijing Academy of Artificial Intelligence[BAAI2019QN0301] ; Key Research Program of the Chinese Academy of Sciences[ZDBS-SSW-JSC006] ; National Laboratory of Pattern Recognition, China ; Youth Innovation Promotion Association CAS, China ; Meituan-Dianping Group |
Funding Organization | National Key Research and Development Program of China ; National Natural Science Foundation of China ; Beijing Academy of Artificial Intelligence ; Key Research Program of the Chinese Academy of Sciences ; National Laboratory of Pattern Recognition, China ; Youth Innovation Promotion Association CAS, China ; Meituan-Dianping Group |
WOS Research Area | Computer Science |
WOS Subject | Computer Science, Artificial Intelligence |
WOS ID | WOS:000679379400017 |
Publisher | ELSEVIER |
Sub direction classification | 自然语言处理 |
Citation statistics | |
Document Type | 期刊论文 |
Identifier | http://ir.ia.ac.cn/handle/173211/45582 |
Collection | 模式识别国家重点实验室_自然语言处理 |
Corresponding Author | Zhao, Jun |
Affiliation | 1.National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, Beijing, 100190, China 2.School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, 100049, China 3.Meituan, Beijing, 100102, China |
First Author Affilication | Chinese Acad Sci, Inst Automat, Natl Lab Pattern Recognit, Beijing 100190, Peoples R China |
Corresponding Author Affilication | Chinese Acad Sci, Inst Automat, Natl Lab Pattern Recognit, Beijing 100190, Peoples R China |
Recommended Citation GB/T 7714 | Liu, Qingbin,Bai, Guirong,He, Shizhu,et al. Heterogeneous Relational Graph Neural Networks with Adaptive Objective for End-to-End Task-Oriented Dialogue[J]. KNOWLEDGE-BASED SYSTEMS,2021,227(2021):107186. |
APA | Liu, Qingbin,Bai, Guirong,He, Shizhu,Liu, Cao,Liu, Kang,&Zhao, Jun.(2021).Heterogeneous Relational Graph Neural Networks with Adaptive Objective for End-to-End Task-Oriented Dialogue.KNOWLEDGE-BASED SYSTEMS,227(2021),107186. |
MLA | Liu, Qingbin,et al."Heterogeneous Relational Graph Neural Networks with Adaptive Objective for End-to-End Task-Oriented Dialogue".KNOWLEDGE-BASED SYSTEMS 227.2021(2021):107186. |
Files in This Item: | ||||||
File Name/Size | DocType | Version | Access | License | ||
KBS-ours.pdf(1021KB) | 期刊论文 | 出版稿 | 开放获取 | CC BY-NC-SA | View |
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment