A Class-specific Copy Network for Handling the Rare Word Problem in Neural Machine Translation
Feng Wang; Wei Chen; Zhen yang; Xiaowei Zhang; Shuang Xu; Bo Xu
2017
会议名称International Joint Conference on Neural Networks
会议录名称IJCNN
页码2658-2664
会议日期14-19 May 2017
会议地点Anchorage, AK, USA
摘要Neural machine translation (NMT) has shown promising results and rapidly gained adoption in many large-scale settings. With the NMT model being widely used in empirical productions, its long-standing weakness in handling the rare and out of vocabulary words has been amplified a lot. In order to release the model from the stress of “understanding” the rare words, copy mechanism has been proposed to deal with the rare and unseen words for the neural network models using attention. However the negative side of the copy mechanism is that the model is only able to decide whether to copy or not. It is unable to detect which class should the rare word be copied to, such as person, location, and organization. This paper deeply investigates this limitation of the NMT model. As a result, we propose a new NMT model by novelly incorporating a class-specific copy network. With the network, the proposed NMT model is able to decide which class the words in the target belong to and which class in the source should be copied to. Experimental results on Chinese-English translation tasks show that the proposed model outperforms the traditional NMT model with a large margin especially for sentences containing the rare words.
关键词Neural Machine Translation (Nmt) Copy Network Rare Word
语种英语
文献类型会议论文
条目标识符http://ir.ia.ac.cn/handle/173211/15428
专题数字内容技术与服务研究中心_听觉模型与认知计算
通讯作者Wei Chen
作者单位Institute of Automation Chinese Academy of Science
推荐引用方式
GB/T 7714
Feng Wang,Wei Chen,Zhen yang,et al. A Class-specific Copy Network for Handling the Rare Word Problem in Neural Machine Translation[C],2017:2658-2664.
条目包含的文件 下载所有文件
文件名称/大小 文献类型 版本类型 开放类型 使用许可
07966181.pdf(361KB)会议论文 开放获取CC BY-NC-SA浏览 下载
个性服务
推荐该条目
保存到收藏夹
查看访问统计
导出为Endnote文件
谷歌学术
谷歌学术中相似的文章
[Feng Wang]的文章
[Wei Chen]的文章
[Zhen yang]的文章
百度学术
百度学术中相似的文章
[Feng Wang]的文章
[Wei Chen]的文章
[Zhen yang]的文章
必应学术
必应学术中相似的文章
[Feng Wang]的文章
[Wei Chen]的文章
[Zhen yang]的文章
相关权益政策
暂无数据
收藏/分享
文件名: 07966181.pdf
格式: Adobe PDF
所有评论 (0)
暂无评论
 

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。