Knowledge Commons of Institute of Automation,CAS
Research on Transfer Learning of Vision-based Gesture Recognition | |
Bi-Xiao Wu1; Chen-Guang Yang1,3; Jun-Pei Zhong2 | |
发表期刊 | International Journal of Automation and Computing |
ISSN | 1476-8186 |
2021 | |
卷号 | 18期号:3页码:422-431 |
摘要 | Gesture recognition has been widely used for human-robot interaction. At present, a problem in gesture recognition is that the researchers did not use the learned knowledge in existing domains to discover and recognize gestures in new domains. For each new domain, it is required to collect and annotate a large amount of data, and the training of the algorithm does not benefit from prior knowledge, leading to redundant calculation workload and excessive time investment. To address this problem, the paper proposes a method that could transfer gesture data in different domains. We use a red-green-blue (RGB) Camera to collect images of the gestures, and use Leap Motion to collect the coordinates of 21 joint points of the human hand. Then, we extract a set of novel feature descriptors from two different distributions of data for the study of transfer learning. This paper compares the effects of three classification algorithms, i.e., support vector machine (SVM), broad learning system (BLS) and deep learning (DL). We also compare learning performances with and without using the joint distribution adaptation (JDA) algorithm. The experimental results show that the proposed method could effectively solve the transfer problem between RGB Camera and Leap Motion. In addition, we found that when using DL to classify the data,excessive training on the source domain may reduce the accuracy of recognition in the target domain. |
关键词 | Transfer learning gesture recognition red-green-blue (RGB) Camera Leap Motion joint distribution adaptation (JDA) |
DOI | 10.1007/s11633-020-1273-9 |
引用统计 | |
文献类型 | 期刊论文 |
条目标识符 | http://ir.ia.ac.cn/handle/173211/44291 |
专题 | 学术期刊_Machine Intelligence Research |
作者单位 | 1.College of Automation Science and Engineering, South China University of Technology, Guangzhou 510640, China 2.Shien-Ming Wu School of Intelligent Engineering, South China University of Technology, Guangzhou 511442, China 3.Foshan Newthinking Intelligent Technology Company Ltd., Foshan 528231, China |
推荐引用方式 GB/T 7714 | Bi-Xiao Wu,Chen-Guang Yang,Jun-Pei Zhong. Research on Transfer Learning of Vision-based Gesture Recognition[J]. International Journal of Automation and Computing,2021,18(3):422-431. |
APA | Bi-Xiao Wu,Chen-Guang Yang,&Jun-Pei Zhong.(2021).Research on Transfer Learning of Vision-based Gesture Recognition.International Journal of Automation and Computing,18(3),422-431. |
MLA | Bi-Xiao Wu,et al."Research on Transfer Learning of Vision-based Gesture Recognition".International Journal of Automation and Computing 18.3(2021):422-431. |
条目包含的文件 | 下载所有文件 | |||||
文件名称/大小 | 文献类型 | 版本类型 | 开放类型 | 使用许可 | ||
IJAC-2020-11-314.pdf(1688KB) | 期刊论文 | 出版稿 | 开放获取 | CC BY-NC-SA | 浏览 下载 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论