Deep Learning Based Hand Gesture Recognition and UAV Flight Controls

doi:10.1007/s11633-019-1194-7

CASIA OpenIR > 学术期刊 > Machine Intelligence Research

	Deep Learning Based Hand Gesture Recognition and UAV Flight Controls
	Bin Hu; Jiacun Wang
发表期刊	International Journal of Automation and Computing
ISSN	1476-8186
	2020
卷号	17 期号:1 页码:17-29
摘要	Dynamic hand gesture recognition is a desired alternative means for human-computer interactions. This paper presents a hand gesture recognition system that is designed for the control of flights of unmanned aerial vehicles (UAV). A data representation model that represents a dynamic gesture sequence by converting the 4-D spatiotemporal data to 2-D matrix and a 1-D array is introduced. To train the system to recognize designed gestures, skeleton data collected from a Leap Motion Controller are converted to two different data models. As many as 9 124 samples of the training dataset, 1 938 samples of the testing dataset are created to train and test the proposed three deep learning neural networks, which are a 2-layer fully connected neural network, a 5-layer fully connected neural network and an 8-layer convolutional neural network. The static testing results show that the 2-layer fully connected neural network achieves an average accuracy of 96.7% on scaled datasets and 12.3% on non-scaled datasets. The 5-layer fully connected neural network achieves an average accuracy of 98.0% on scaled datasets and 89.1% on non-scaled datasets. The 8-layer convolutional neural network achieves an average accuracy of 89.6% on scaled datasets and 96.9% on non-scaled datasets. Testing on a drone-kit simulator and a real drone shows that this system is feasible for drone flight controls.
关键词	Deep learning neural networks hand gesture recognition Leap Motion Controllers drones.
DOI	10.1007/s11633-019-1194-7
引用统计	被引频次：73[WOS] [WOS记录] [WOS相关记录]
文献类型	期刊论文
条目标识符	http://ir.ia.ac.cn/handle/173211/42307
专题	学术期刊_Machine Intelligence Research
作者单位	Monmouth University, West Long Branch, NJ 07764, USA
推荐引用方式 GB/T 7714	Bin Hu,Jiacun Wang. Deep Learning Based Hand Gesture Recognition and UAV Flight Controls[J]. International Journal of Automation and Computing,2020,17(1):17-29.
APA	Bin Hu,&Jiacun Wang.(2020).Deep Learning Based Hand Gesture Recognition and UAV Flight Controls.International Journal of Automation and Computing,17(1),17-29.
MLA	Bin Hu,et al."Deep Learning Based Hand Gesture Recognition and UAV Flight Controls".International Journal of Automation and Computing 17.1(2020):17-29.

条目包含的文件		下载所有文件
文件名称/大小	文献类型	版本类型	开放类型	使用许可
IJAC-AC-2019-03-052.（1357KB）	期刊论文	出版稿	开放获取	CC BY-NC-SA	浏览下载