CASIA OpenIR  > 综合信息系统研究中心  > 视知觉融合及其应用
Learning to Deliberate: Multi-Pass Decoding for Document-Grounded Conversations
Junyan Qiu1,2; Haitao Wang3; Yiping Yang2
2024-03
Conference NameInternational Joint Conference on Neural Networks
Conference Date2024-07
Conference PlaceYOKOHAMA, JAPAN
PublisherIEEE
Abstract

Document-grounded conversations are designed to generate and engage in conversations based on specific documents or texts provided as context. The ability to incorporate documents into these conversations enables a deeper understanding of the subject matter, fostering more informed and meaningful discussions. However, prior approaches were predominantly rooted in auto-regressive models, overlooking the need for a comprehensive global perspective and the refinement of responses. In this paper, we introduce an innovative Multi-Pass Decoding (MPD) architecture, which iteratively updates background knowledge and enhances responses in document-grounded conversations. During each iteration, it starts by adaptively combining semantics derived from the context, documents, and previous responses. To address the issue of inadequate response quality, we have also developed two modules dedicated to identifying and refining inappropriate words or phrases in responses generated during the previous iteration. Furthermore, MPD is model-agnostic, enabling seamless integration with conventional sequence-to-sequence frameworks. Our empirical experiments on three document-grounded conversation datasets demonstrate that our methods facilitate the production of more contextually accurate and coherent responses.

Keyworddialogue system document-grounded conversations deliberation network sequence-to-sequence framework
MOST Discipline Catalogue工学::计算机科学与技术(可授工学、理学学位)
Indexed ByEI
Sub direction classification自然语言处理
planning direction of the national heavy laboratory语音语言处理
Paper associated data
Document Type会议论文
Identifierhttp://ir.ia.ac.cn/handle/173211/57411
Collection综合信息系统研究中心_视知觉融合及其应用
Corresponding AuthorJunyan Qiu
Affiliation1.University of Chinese Academy of Sciences
2.Institute of Automation, Chinese Academy of Sciences
3.Meituan
First Author AffilicationInstitute of Automation, Chinese Academy of Sciences
Corresponding Author AffilicationInstitute of Automation, Chinese Academy of Sciences
Recommended Citation
GB/T 7714
Junyan Qiu,Haitao Wang,Yiping Yang. Learning to Deliberate: Multi-Pass Decoding for Document-Grounded Conversations[C]:IEEE,2024.
Files in This Item: Download All
File Name/Size DocType Version Access License
a69-qiu final.pdf(1033KB)会议论文 开放获取CC BY-NC-SAView Download
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Junyan Qiu]'s Articles
[Haitao Wang]'s Articles
[Yiping Yang]'s Articles
Baidu academic
Similar articles in Baidu academic
[Junyan Qiu]'s Articles
[Haitao Wang]'s Articles
[Yiping Yang]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Junyan Qiu]'s Articles
[Haitao Wang]'s Articles
[Yiping Yang]'s Articles
Terms of Use
No data!
Social Bookmark/Share
File name: a69-qiu final.pdf
Format: Adobe PDF
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.