Temporal dendritic heterogeneity incorporated with spiking neural networks for learning multi-timescale dynamics

doi:10.1038/s41467-023-44614-z

CASIA OpenIR > 脑图谱与类脑智能实验室

	Temporal dendritic heterogeneity incorporated with spiking neural networks for learning multi-timescale dynamics
	Zheng, Hanle 1; Zheng, Zhong 1; Hu, Rui 1; Xiao, Bo 1; Wu, Yujie 2; Yu, Fangwen 1; Liu, Xue 1; Li, Guoqi3 ; Deng, Lei 1
发表期刊	NATURE COMMUNICATIONS
	2024-01-04
卷号	15 期号:1 页码:20
通讯作者	Deng, Lei(leideng@mail.tsinghua.edu.cn)
摘要	It is widely believed the brain-inspired spiking neural networks have the capability of processing temporal information owing to their dynamic attributes. However, how to understand what kind of mechanisms contributing to the learning ability and exploit the rich dynamic properties of spiking neural networks to satisfactorily solve complex temporal computing tasks in practice still remains to be explored. In this article, we identify the importance of capturing the multi-timescale components, based on which a multi-compartment spiking neural model with temporal dendritic heterogeneity, is proposed. The model enables multi-timescale dynamics by automatically learning heterogeneous timing factors on different dendritic branches. Two breakthroughs are made through extensive experiments: the working mechanism of the proposed model is revealed via an elaborated temporal spiking XOR problem to analyze the temporal feature integration at different levels; comprehensive performance benefits of the model over ordinary spiking neural networks are achieved on several temporal computing benchmarks for speech recognition, visual recognition, electroencephalogram signal recognition, and robot place recognition, which shows the best-reported accuracy and model compactness, promising robustness and generalization, and high execution efficiency on neuromorphic hardware. This work moves neuromorphic computing a significant step toward real-world applications by appropriately exploiting biological observations. Brain-inspired spiking neural networks have shown their capability for effective learning, however current models may not consider realistic heterogeneities present in the brain. The authors propose a neuron model with temporal dendritic heterogeneity for improved neuromorphic computing applications.
DOI	10.1038/s41467-023-44614-z
关键词[WOS]	EMOTION RECOGNITION ; DIVERSITY ; NEURONS ; CLASSIFICATION ; PLASTICITY ; ACCURATE
收录类别	SCI
语种	英语
资助项目	STI[2021ZD0200300] ; National Natural Science Foundation of China[62276151] ; National Natural Science Foundation of China[62106119] ; National Natural Science Foundation of China[62236009] ; National Natural Science Foundation of China[U22A20103] ; National Science Foundation for Distinguished Young Scholars[62325603] ; Chinese Institute for Brain Research
项目资助者	STI ; National Natural Science Foundation of China ; National Science Foundation for Distinguished Young Scholars ; Chinese Institute for Brain Research
WOS研究方向	Science & Technology - Other Topics
WOS类目	Multidisciplinary Sciences
WOS记录号	WOS:001136901800010
出版者	NATURE PORTFOLIO
引用统计	被引频次：2[WOS] [WOS记录] [WOS相关记录]
文献类型	期刊论文
条目标识符	http://ir.ia.ac.cn/handle/173211/54805
专题	脑图谱与类脑智能实验室
通讯作者	Deng, Lei
作者单位	1.Tsinghua Univ, Ctr Brain Inspired Comp Res CBICR, Dept Precis Instrument, Beijing, Peoples R China 2.Graz Univ Technol, Inst Theoret Comp Sci, Graz, Austria 3.Chinese Acad Sci, Inst Automat, Beijing, Peoples R China
推荐引用方式 GB/T 7714	Zheng, Hanle,Zheng, Zhong,Hu, Rui,et al. Temporal dendritic heterogeneity incorporated with spiking neural networks for learning multi-timescale dynamics[J]. NATURE COMMUNICATIONS,2024,15(1):20.
APA	Zheng, Hanle.,Zheng, Zhong.,Hu, Rui.,Xiao, Bo.,Wu, Yujie.,...&Deng, Lei.(2024).Temporal dendritic heterogeneity incorporated with spiking neural networks for learning multi-timescale dynamics.NATURE COMMUNICATIONS,15(1),20.
MLA	Zheng, Hanle,et al."Temporal dendritic heterogeneity incorporated with spiking neural networks for learning multi-timescale dynamics".NATURE COMMUNICATIONS 15.1(2024):20.