Knowledge Commons of Institute of Automation,CAS
Dynamic Context Selection for Document-level Neural Machine Translation via Reinforcement Learning | |
Kang, Xiaomian1,2; Zhao, Yang1,2; Zhang, Jiajun1,2,3; Zong, Chengqing1,2,4 | |
2020-11 | |
会议名称 | The 2020 Conference on Empirical Methods in Natural Language Processing |
会议日期 | November 16–20, 2020 |
会议地点 | Online |
摘要 | Document-level neural machine translation has yielded attractive improvements. However, majority of existing methods roughly use all context sentences in a fixed scope. They neglect the fact that different source sentences need different sizes of context. To address this problem, we propose an effective approach to select dynamic context so that the document-level translation model can utilize the more useful selected context sentences to produce better translations. Specifically, we introduce a selection module that is independent of the translation module to score each candidate context sentence. Then, we propose two strategies to explicitly select a variable number of context sentences and feed them into the translation module. We train the two modules end-to-end via reinforcement learning. A novel reward is proposed to encourage the selection and utilization of dynamic context sentences. Experiments demonstrate that our approach can select adaptive context sentences for different source sentences, and significantly improves the performance of document-level translation methods. |
关键词 | Docment-level NMT Neural Machine Translation Reinforcement Learning Context Selection |
收录类别 | EI |
语种 | 英语 |
七大方向——子方向分类 | 自然语言处理 |
文献类型 | 会议论文 |
条目标识符 | http://ir.ia.ac.cn/handle/173211/44305 |
专题 | 多模态人工智能系统全国重点实验室_自然语言处理 |
作者单位 | 1.National Laboratory of Pattern Recognition, Institute of Automation, CAS, Beijing, China 2.Beijing Academy of Artificial Intelligence, Beijing, China 3.CAS Center for Excellence in Brain Science and Intelligence Technology, Beijing, China 4.School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, China |
第一作者单位 | 模式识别国家重点实验室 |
推荐引用方式 GB/T 7714 | Kang, Xiaomian,Zhao, Yang,Zhang, Jiajun,et al. Dynamic Context Selection for Document-level Neural Machine Translation via Reinforcement Learning[C],2020. |
条目包含的文件 | 下载所有文件 | |||||
文件名称/大小 | 文献类型 | 版本类型 | 开放类型 | 使用许可 | ||
EMNLP2020_xiaomianka(978KB) | 会议论文 | 开放获取 | CC BY-NC-SA | 浏览 下载 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论