CASIA OpenIR  > 国家专用集成电路设计工程技术研究中心
Low Latency Spiking ConvNets with Restricted Output Training and False Spike Inhibition
Chen RZ(陈睿智)1,2; Ma H(马鸿)1; Guo P(郭鹏)1; Xie SL(谢少林)1; Wang DL(王东琳)1
2018-10
Conference Name2018 International Joint Conference on Neural Networks (IJCNN)
Conference Date2018-7
Conference Place巴西里约热内卢
Abstract

Deep convolutional neural networks (ConvNets) have achieved the state-of-the-art performance on many real-world applications. However, significant computation and storage demands are required by ConvNets. Spiking neural networks (SNNs), with sparsely activated neurons and event-driven computations, show great potential to take advantage of the ultra-low power spike-based hardware architectures. Yet, training SNN with similar accuracy as ConvNets is difficult. Recent researchers have demonstrated the work of converting ConvNets to SNNs (CNN-SNN conversion) with similar accuracy. However, the energy-efficiency of the converted SNNs is impaired by the increased classification latency. In this paper, we focus on optimizing the classification latency of the converted SNNs. First, we propose a restricted output training method to normalize the converted weights dynamically in the CNN-SNN training phase. Second, false spikes are identified and the false spike inhibition theory is derived to speedup the convergence of the classification process. Third, we propose a temporal max pooling method to approximate the max pooling operation in ConvNets without accuracy loss. The evaluation shows that the converted SNNs converge in about 30 time-steps and achieve the best classification accuracy of 94% on CIFAR-10 dataset.

Indexed ByEI
Language英语
Document Type会议论文
Identifierhttp://ir.ia.ac.cn/handle/173211/23614
Collection国家专用集成电路设计工程技术研究中心
Affiliation1.中国科学院自动化研究所
2.中国科学院大学
First Author AffilicationInstitute of Automation, Chinese Academy of Sciences
Recommended Citation
GB/T 7714
Chen RZ,Ma H,Guo P,et al. Low Latency Spiking ConvNets with Restricted Output Training and False Spike Inhibition[C],2018.
Files in This Item: Download All
File Name/Size DocType Version Access License
paper1.pdf(11839KB)会议论文 开放获取CC BY-NC-SAView Download
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Chen RZ(陈睿智)]'s Articles
[Ma H(马鸿)]'s Articles
[Guo P(郭鹏)]'s Articles
Baidu academic
Similar articles in Baidu academic
[Chen RZ(陈睿智)]'s Articles
[Ma H(马鸿)]'s Articles
[Guo P(郭鹏)]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Chen RZ(陈睿智)]'s Articles
[Ma H(马鸿)]'s Articles
[Guo P(郭鹏)]'s Articles
Terms of Use
No data!
Social Bookmark/Share
File name: paper1.pdf
Format: Adobe PDF
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.