Multi-sense based neural machine translation

	Multi-sense based neural machine translation
	Yang Z(杨振); Chen W(陈炜); Wang F(王峰); Wang F(王峰); Chen W(陈炜)
	2017-07-03
会议名称	International Joint Conference on Neural Networks
会议日期	2017-5-4
会议地点	Anchorage, AK, USA
摘要	Attention mechanism advances the neural machine translation (NMT) by reducing the confusion introduced by irrelevant words in long sentences. However, the confusion caused by ambiguous words hasn’t been handled yet and it may be a bottleneck for the NMT model. This paper validates the hypothesis and proposes a simple and flexible framework, which enables the NMT model to only focus on the relevant sense type of the input word in current context. Experiments show that the proposed model achieves substantial improvements on every test set over competitive baselines. Our contributions come from twofold. Firstly, to the best of our knowledge, this is the first effort to introduce the multi-sense representation, which represents each sense type of the word with a sense-specific embedding, into NMT. Secondly, We propose a sense search module which can detect the sense type of the word automatically. Flexibility and versatility are the most attractive characteristic of the proposed sense search module. It can be applied to any other semantic related NLP tasks with little modification.
收录类别	EI
文献类型	会议论文
条目标识符	http://ir.ia.ac.cn/handle/173211/41018
专题	复杂系统认知与决策实验室_听觉模型与认知计算数字内容技术与服务研究中心
通讯作者	Chen W(陈炜)
推荐引用方式 GB/T 7714	Yang Z,Chen W,Wang F,et al. Multi-sense based neural machine translation[C],2017.