Adversarial Feature Sampling Learning for Efficient Visual Tracking

doi:10.1109/TASE.2019.2948402

CASIA OpenIR > 中科院工业视觉智能装备工程实验室 > 精密感知与控制

	Adversarial Feature Sampling Learning for Efficient Visual Tracking
	Yin, Yingjie1,2,3 ; Xu, De1,3 ; Wang, Xingang1,3 ; Zhang, Lei 2
发表期刊	IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING
ISSN	1545-5955
	2020-04-01
卷号	17 期号:2 页码:847-857
通讯作者	Xu, De(de.xu@ia.ac.cn)
摘要	The tracking-by-detection tracking framework usually consists of two stages: drawing samples around the target object and classifying each sample as either the target object or background. Current popular trackers under this framework typically draw many samples from the raw image and feed them into the deep neural networks, resulting in high computational burden and low tracking speed. In this article, we propose an adversarial feature sampling learning (AFSL) method to address this problem. A convolutional neural network is designed, which takes only one cropped image around the target object as input, and samples are collected from the feature maps with spatial bilinear resampling. To enrich the appearance variations of positive samples in the feature space, which has limited spatial resolution, we fuse the high-level features and low-level features to better describe the target by using a generative adversarial network. Extensive experiments on benchmark data sets demonstrate that the proposed ASFL achieves leading tracking accuracy while significantly accelerating the speed of tracking-by-detection trackers. Note to Practitioners-Visual tracking can be applied in many intelligent automation systems, such as robotic intelligent navigation system, intelligent human-computer interaction system, and so on. In a robotic intelligent navigation system, visual tracking can generate target's motion trajectory from image sequences. Visual tracking can also obtain body movement information automatically during the interactive process in the intelligent human-computer interaction system. Accuracy and speed are two key indicators for visual tracking, and intelligent automation systems usually need a tracker with more accuracy and faster speed. This article aims to develop a fast and accurate tracking method by adversarial feature sampling learning (AFSL). In the concrete implementation process, AFSL gets samples by sampling in the feature space rather than on raw images to reduce computation. Then, an adversarial learning mechanism is adopted to boost the sampling features and enrich the target appearances in the feature space to improve the tracking accuracy. The proposed tracker is proven to be effective to keep leading tracking accuracy while significantly accelerating the tracking speed.
关键词	Adversarial learning deep convolution neural network feature sampling visual tracking
DOI	10.1109/TASE.2019.2948402
关键词[WOS]	OBJECT TRACKING
收录类别	SCI
语种	英语
资助项目	National Key Research and Development Program of China[2018YFD0400902] ; National Natural Science Foundation of China[61703398] ; National Natural Science Foundation of China[61733004] ; National Natural Science Foundation of China[61573349] ; Hong Kong Scholars Program[XJ2017031]
项目资助者	National Key Research and Development Program of China ; National Natural Science Foundation of China ; Hong Kong Scholars Program
WOS研究方向	Automation & Control Systems
WOS类目	Automation & Control Systems
WOS记录号	WOS:000528673100025
出版者	IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
七大方向——子方向分类	目标检测、跟踪与识别
引用统计	被引频次：5[WOS] [WOS记录] [WOS相关记录]
文献类型	期刊论文
条目标识符	http://ir.ia.ac.cn/handle/173211/39388
专题	中科院工业视觉智能装备工程实验室_精密感知与控制
通讯作者	Xu, De
作者单位	1.Chinese Acad Sci, Res Ctr Precis Sensing & Control, Inst Automat, Beijing 100190, Peoples R China 2.Hong Kong Polytech Univ, Dept Comp, Hong Kong, Peoples R China 3.Univ Chinese Acad Sci, Sch Artificial Intelligence, Beijing 100049, Peoples R China
第一作者单位	精密感知与控制研究中心
通讯作者单位	精密感知与控制研究中心
推荐引用方式 GB/T 7714	Yin, Yingjie,Xu, De,Wang, Xingang,et al. Adversarial Feature Sampling Learning for Efficient Visual Tracking[J]. IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING,2020,17(2):847-857.
APA	Yin, Yingjie,Xu, De,Wang, Xingang,&Zhang, Lei.(2020).Adversarial Feature Sampling Learning for Efficient Visual Tracking.IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING,17(2),847-857.
MLA	Yin, Yingjie,et al."Adversarial Feature Sampling Learning for Efficient Visual Tracking".IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING 17.2(2020):847-857.