Dynamic hand gesture recognition using motion pattern and shape descriptors
Xing, Meng1; Hu, Jing1; Feng, Zhiyong2; Su, Yong1; Peng, Weilong1; Zheng, Jinqing3
Corresponding AuthorFeng, Zhiyong(
AbstractThe key problems of dynamic hand gesture recognition are large intra-class (gesture types, without considering hand configuration) spatial-temporal variability and similar inter-class (gesture types, only considering hand configuration) motion pattern. Firstly, for intra-class spatial-temporal variability, the key is to reduce the spatial-temporal variability. Due to the average operation can improve the robustness very well, we propose a motion pattern descriptor, Time-Wise Histograms of Oriented Gradients (TWHOG), which extracts the average spatial-temporal information in the space-time domain from three orthogonal projection views (XY, YT, XT). Secondly, for similar inter-class motion pattern, accurate representation of hand configuration is especially important. Therefore, the difference in detail needs to be fully captured, and the shape descriptor can amplify subtle differences. Specifically, we introduce Depth Motion Maps-based Histograms of Oriented Gradients (DMM-HOG) to capture subtle differences in hand configurations between different types of gestures with similar motion patterns. Finally, we concatenate TWHOG and DMM-HOG to form the final feature vector Time-Shape Histograms of Oriented Gradients (TSHOG) and verify the effectiveness of the connection from quantitative and qualitative perspective. Comparison study with the state-of-the-art approaches are conducted on two challenge depth gesture datasets (MSRGesture3D, SKIG). The experiment result shows that TSHOG can achieve satisfactory performance while keeping a relative simple model with lower complexity as well as higher generality.
KeywordDynamic hand gesture recognition Hand configuration Spatial-temporal variability Motion pattern descriptor Shape descriptor
Indexed BySCI
WOS Research AreaComputer Science ; Engineering
WOS SubjectComputer Science, Information Systems ; Computer Science, Software Engineering ; Computer Science, Theory & Methods ; Engineering, Electrical & Electronic
WOS IDWOS:000467495400050
Citation statistics
Document Type期刊论文
Corresponding AuthorFeng, Zhiyong
Affiliation1.Tianjin Univ, Sch Comp Sci & Technol, Tianjin 300072, Peoples R China
2.Tianjin Univ, Sch Comp Software, Tianjin 300072, Peoples R China
3.Chinese Acad Sci, Inst Automat, Beijing 100190, Peoples R China
Recommended Citation
GB/T 7714
Xing, Meng,Hu, Jing,Feng, Zhiyong,et al. Dynamic hand gesture recognition using motion pattern and shape descriptors[J]. MULTIMEDIA TOOLS AND APPLICATIONS,2019,78(8):10649-10672.
APA Xing, Meng,Hu, Jing,Feng, Zhiyong,Su, Yong,Peng, Weilong,&Zheng, Jinqing.(2019).Dynamic hand gesture recognition using motion pattern and shape descriptors.MULTIMEDIA TOOLS AND APPLICATIONS,78(8),10649-10672.
MLA Xing, Meng,et al."Dynamic hand gesture recognition using motion pattern and shape descriptors".MULTIMEDIA TOOLS AND APPLICATIONS 78.8(2019):10649-10672.
Files in This Item:
There are no files associated with this item.
Related Services
Recommend this item
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Xing, Meng]'s Articles
[Hu, Jing]'s Articles
[Feng, Zhiyong]'s Articles
Baidu academic
Similar articles in Baidu academic
[Xing, Meng]'s Articles
[Hu, Jing]'s Articles
[Feng, Zhiyong]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Xing, Meng]'s Articles
[Hu, Jing]'s Articles
[Feng, Zhiyong]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.