CASIA OpenIR  > 智能制造技术与系统研究中心  > 智能机器人
Real-time Scene Recognition on Embedded System with SIFT Keypoints and a New Descriptor
Xiao, Han; He, Wenhao; Yuan, Kui; Wen, Feng
Conference Name2013 IEEE International Conference on Mechatronics and Automation
Source Publication2013 IEEE International Conference on Mechatronics and Automation
Conference DateAug. 4-7, 2013
Conference PlaceTakamatsu, Japan
AbstractThe vision system of a mobile robot has to interpret the environment in real time at low power. As a good algorithm for extracting information from images, SIFT (Scale Invariant Feature Transform) is widely used in computer vision. However, the high computational complexity makes it hard to achieve real-time performance of SIFT with pure software. This paper presents a machine vision system implementing the SIFT algorithm on an embedded image processing card, where real-time scene recognition is accomplished with low power consumption through the cooperation between an FPGA (Field Programmable Gate Array) and a DSP (Digital Signal Processor) chip. The original SIFT keypoint detection algorithm is adapted for parallel computation and implemented with a hardware pipeline in the FPGA. Although our current system is designed for 360x288 video frames, this pipelined architecture can be applied to images with arbitrary resolution. Meanwhile, the original 128-dimensional SIFT descriptor is replaced by an 18-dimensional new descriptor which can be generated more efficiently and can be matched according to an absolute distance threshold with the distance defined by infinity-norm. On this basis, a five-branch-tree data structure is designed for fast searching and matching of descriptors, and robust scene recognition is realized through the combination of keypoints. Since our new descriptor allows one keypoint to be matched to several keypoints, which is a distinct property from the original SIFT algorithm, our system can recognize multiple images with overlapping contents simultaneously. In addition, compared with traditional work that needs off-line training, our system can perform fast on-line learning, which is a desirable property for mobile robots.
KeywordFpga Sift Descriptor Image Recognition Real-time
Document Type会议论文
Corresponding AuthorXiao, Han
AffiliationInstitute of Automation, Chinese Academy of Sciences
Recommended Citation
GB/T 7714
Xiao, Han,He, Wenhao,Yuan, Kui,et al. Real-time Scene Recognition on Embedded System with SIFT Keypoints and a New Descriptor[C],2013.
Files in This Item: Download All
File Name/Size DocType Version Access License
2013_Real-time Scene(2200KB)会议论文 开放获取CC BY-NC-SAView Download
Related Services
Recommend this item
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Xiao, Han]'s Articles
[He, Wenhao]'s Articles
[Yuan, Kui]'s Articles
Baidu academic
Similar articles in Baidu academic
[Xiao, Han]'s Articles
[He, Wenhao]'s Articles
[Yuan, Kui]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Xiao, Han]'s Articles
[He, Wenhao]'s Articles
[Yuan, Kui]'s Articles
Terms of Use
No data!
Social Bookmark/Share
File name: 2013_Real-time Scene.pdf
Format: Adobe PDF
All comments (0)
No comment.

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.