CASIA OpenIR  > 模式识别国家重点实验室  > 自然语言处理
A Study of the Effectiveness of Suffixes for Chinese Word Segmentation
Li XQ(李小青); Zong Chengqing; Su Keh-Yih; Li, Xiaoqing
2013
Conference NamePacific Asia Conference on Language, Information, and Computation
Source PublicationProceedings of 27th Pacific Asia Conference on Language, Information, and Computation
Conference DateNovember 22-24
Conference PlaceTaipei
Abstract
We investigate whether suffix related features can significantly improve the performance of
character-based approaches for Chinese word segmentation (CWS). Since suffixes are quite productive in forming new words, and OOV is the main error source for CWS, many researchers expect that suffix information can further improve the performance. With this
belief, we tried several suffix related features in both generative and discriminative approaches. However, our experiment results have shown that significant improvement can hardly be achieved by incorporating suffix related features into those widely adopted
surface features, which is against the commonly believed supposition. Error analysis reveals that the main problem behind this surprising finding is the conflict between the degree of reliability and the coverage rate of suffix related features.
KeywordChinese Word Segmentation Suffix
Document Type会议论文
Identifierhttp://ir.ia.ac.cn/handle/173211/13015
Collection模式识别国家重点实验室_自然语言处理
Corresponding AuthorLi, Xiaoqing
Affiliation中国科学院自动化研究所
Recommended Citation
GB/T 7714
Li XQ,Zong Chengqing,Su Keh-Yih,et al. A Study of the Effectiveness of Suffixes for Chinese Word Segmentation[C],2013.
Files in This Item: Download All
File Name/Size DocType Version Access License
A Study of the Effec(345KB)会议论文 开放获取CC BY-NC-SAView Download
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Li XQ(李小青)]'s Articles
[Zong Chengqing]'s Articles
[Su Keh-Yih]'s Articles
Baidu academic
Similar articles in Baidu academic
[Li XQ(李小青)]'s Articles
[Zong Chengqing]'s Articles
[Su Keh-Yih]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Li XQ(李小青)]'s Articles
[Zong Chengqing]'s Articles
[Su Keh-Yih]'s Articles
Terms of Use
No data!
Social Bookmark/Share
File name: A Study of the Effectiveness of Suffixes for Chinese Word Segmentation.pdf
Format: Adobe PDF
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.