CASIA OpenIR  > 模式识别国家重点实验室  > 多媒体计算与图形学
Latent Support Vector Machine Modeling for Sign Language Recognition with Kinect
Sun, Chao; Zhang, Tianzhu; Xu, Changsheng
Source PublicationACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY
2015-05-01
Volume6Issue:2
SubtypeArticle
AbstractVision-based sign language recognition has attracted more and more interest from researchers in the computer vision field. In this article, we propose a novel algorithm to model and recognize sign language performed in front of a Microsoft Kinect sensor. Under the assumption that some frames are expected to be both discriminative and representative in a sign language video, we first assign a binary latent variable to each frame in training videos for indicating its discriminative capability, then develop a latent support vector machine model to classify the signs, as well as localize the discriminative and representative frames in each video. In addition, we utilize the depth map together with the color image captured by the Kinect sensor to obtain a more effective and accurate feature to enhance the recognition accuracy. To evaluate our approach, we conducted experiments on both word-level sign language and sentence-level sign language. An American Sign Language dataset including approximately 2,000 word-level sign language phrases and 2,000 sentence-level sign language phrases was collected using the Kinect sensor, and each phrase contains color, depth, and skeleton information. Experiments on our dataset demonstrate the effectiveness of the proposed method for sign language recognition.
KeywordAlgorithms Experimentation Performance Sign Language Recognition Kinect Sensor Latent Svm
WOS HeadingsScience & Technology ; Technology
WOS KeywordGESTURE RECOGNITION ; VIDEO ; ANNOTATION ; FRAMEWORK
Indexed BySCI
Language英语
WOS Research AreaComputer Science
WOS SubjectComputer Science, Artificial Intelligence ; Computer Science, Information Systems
WOS IDWOS:000354049800010
Citation statistics
Cited Times:5[WOS]   [WOS Record]     [Related Records in WOS]
Document Type期刊论文
Identifierhttp://ir.ia.ac.cn/handle/173211/8072
Collection模式识别国家重点实验室_多媒体计算与图形学
AffiliationChinese Acad Sci, Inst Automat, Natl Lab Pattern Recognit, Beijing 100190, Peoples R China
Recommended Citation
GB/T 7714
Sun, Chao,Zhang, Tianzhu,Xu, Changsheng. Latent Support Vector Machine Modeling for Sign Language Recognition with Kinect[J]. ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY,2015,6(2).
APA Sun, Chao,Zhang, Tianzhu,&Xu, Changsheng.(2015).Latent Support Vector Machine Modeling for Sign Language Recognition with Kinect.ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY,6(2).
MLA Sun, Chao,et al."Latent Support Vector Machine Modeling for Sign Language Recognition with Kinect".ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY 6.2(2015).
Files in This Item: Download All
File Name/Size DocType Version Access License
TIST15_Latent Suppor(1484KB)期刊论文作者接受稿开放获取CC BY-NC-SAView Download
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Sun, Chao]'s Articles
[Zhang, Tianzhu]'s Articles
[Xu, Changsheng]'s Articles
Baidu academic
Similar articles in Baidu academic
[Sun, Chao]'s Articles
[Zhang, Tianzhu]'s Articles
[Xu, Changsheng]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Sun, Chao]'s Articles
[Zhang, Tianzhu]'s Articles
[Xu, Changsheng]'s Articles
Terms of Use
No data!
Social Bookmark/Share
File name: TIST15_Latent Support Vector Machine Modeling.pdf
Format: Adobe PDF
This file does not support browsing at this time
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.