A Study of the Effectiveness of Suffixes for Chinese Word Segmentation

CASIA OpenIR > 多模态人工智能系统全国重点实验室 > 自然语言处理

	A Study of the Effectiveness of Suffixes for Chinese Word Segmentation
	Li XQ(李小青); Zong Chengqing; Su Keh-Yih; Li, Xiaoqing
	2013
会议名称	Pacific Asia Conference on Language, Information, and Computation
会议录名称	Proceedings of 27th Pacific Asia Conference on Language, Information, and Computation
会议日期	November 22-24
会议地点	Taipei
摘要	We investigate whether suffix related features can significantly improve the performance of character-based approaches for Chinese word segmentation (CWS). Since suffixes are quite productive in forming new words, and OOV is the main error source for CWS, many researchers expect that suffix information can further improve the performance. With this belief, we tried several suffix related features in both generative and discriminative approaches. However, our experiment results have shown that significant improvement can hardly be achieved by incorporating suffix related features into those widely adopted surface features, which is against the commonly believed supposition. Error analysis reveals that the main problem behind this surprising finding is the conflict between the degree of reliability and the coverage rate of suffix related features.
关键词	Chinese Word Segmentation Suffix
文献类型	会议论文
条目标识符	http://ir.ia.ac.cn/handle/173211/41250
专题	多模态人工智能系统全国重点实验室_自然语言处理
通讯作者	Li, Xiaoqing
推荐引用方式 GB/T 7714	Li XQ,Zong Chengqing,Su Keh-Yih,et al. A Study of the Effectiveness of Suffixes for Chinese Word Segmentation[C],2013.