CASIA OpenIR  > 数字内容技术与服务研究中心  > 听觉模型与认知计算
Multi-sense based neural machine translation
Yang Z(杨振); Chen W(陈炜); Wang F(王峰); Wang F(王峰); Chen W(陈炜)
2017-07-03
Conference NameInternational Joint Conference on Neural Networks
Conference Date2017-5-4
Conference PlaceAnchorage, AK, USA
Abstract
Attention mechanism advances the neural machine
translation (NMT) by reducing the confusion introduced by
irrelevant words in long sentences. However, the confusion caused
by ambiguous words hasn’t been handled yet and it may be
a bottleneck for the NMT model. This paper validates the
hypothesis and proposes a simple and flexible framework, which
enables the NMT model to only focus on the relevant sense type
of the input word in current context. Experiments show that the
proposed model achieves substantial improvements on every test
set over competitive baselines. Our contributions come from twofold.
Firstly, to the best of our knowledge, this is the first effort to
introduce the multi-sense representation, which represents each
sense type of the word with a sense-specific embedding, into
NMT. Secondly, We propose a sense search module which can
detect the sense type of the word automatically. Flexibility and
versatility are the most attractive characteristic of the proposed
sense search module. It can be applied to any other semantic
related NLP tasks with little modification.
Indexed ByEI
Document Type会议论文
Identifierhttp://ir.ia.ac.cn/handle/173211/19653
Collection数字内容技术与服务研究中心_听觉模型与认知计算
Corresponding AuthorChen W(陈炜)
Recommended Citation
GB/T 7714
Yang Z,Chen W,Wang F,et al. Multi-sense based neural machine translation[C],2017.
Files in This Item: Download All
File Name/Size DocType Version Access License
bare_conf.pdf(960KB)会议论文 开放获取CC BY-NC-SAView Download
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Yang Z(杨振)]'s Articles
[Chen W(陈炜)]'s Articles
[Wang F(王峰)]'s Articles
Baidu academic
Similar articles in Baidu academic
[Yang Z(杨振)]'s Articles
[Chen W(陈炜)]'s Articles
[Wang F(王峰)]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Yang Z(杨振)]'s Articles
[Chen W(陈炜)]'s Articles
[Wang F(王峰)]'s Articles
Terms of Use
No data!
Social Bookmark/Share
File name: bare_conf.pdf
Format: Adobe PDF
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.