CASIA OpenIR  > 类脑智能研究中心  > 神经计算与脑机交互
Learning "What" and "Where": An Interpretable Neural Encoding Model
Wang, Haibao1,2; Huang, Lijie1; Du, Changde1,2; He, Huiguang1,2,3
2019-08
Conference NameInternational Joint Conference on Neural Networks
Conference DateJuly 14-19, 2019
Conference PlaceBudapest, Hungary
Abstract

Neural encoding modeling aims to reveal how brain processes perceived information by establishing a quantitative relationship between stimuli and evoked brain activities. In the field of visual neuroscience, many studies have been dedicated to building the neural encoding model for primary visual cortex and demonstrate that the population receptive field (pRF) models can be used to explain how neurons in primary visual cortex work. However, these models rely on either the inflexible prior assumptions imposed on the spatial characteristics of pRF or the clumsy parameter estimation methods which requires too much manual adjustment. Suffering from these issues, current methods yield dissatisfactory performance on mimicking brain activity. In this paper, we address the problems under a novel “what” and “where” neural encoding framework. Basing on deep neural network (DNN) and the separability of the spatial (“where”) and visual feature (“what”) dimensions, the proposed method is not only powerful in extracting nonlinear features from images, but also rich in interpretability. Owing to two forms of regular- ization: sparsity and smoothness, receptive fields are estimated automatically for each voxel without prior assumptions on shape, which gets rid of the shortcomings of previous methods. Extensive empirical evaluations on publicly available fMRI dataset show that the proposed method has superior performance gains over several existing methods.

Indexed ByEI
Language英语
Document Type会议论文
Identifierhttp://ir.ia.ac.cn/handle/173211/39165
Collection类脑智能研究中心_神经计算与脑机交互
Corresponding AuthorHe, Huiguang
Affiliation1.Research Center for Brain-Inspired Intelligence, Institute of Automation, Chinese Academy of Sciences
2.University of Chinese Academy of Sciences
3.Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences
First Author AffilicationInstitute of Automation, Chinese Academy of Sciences
Corresponding Author AffilicationInstitute of Automation, Chinese Academy of Sciences
Recommended Citation
GB/T 7714
Wang, Haibao,Huang, Lijie,Du, Changde,et al. Learning "What" and "Where": An Interpretable Neural Encoding Model[C],2019.
Files in This Item: Download All
File Name/Size DocType Version Access License
ijcnn.pdf(865KB)会议论文 开放获取CC BY-NC-SAView Download
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Wang, Haibao]'s Articles
[Huang, Lijie]'s Articles
[Du, Changde]'s Articles
Baidu academic
Similar articles in Baidu academic
[Wang, Haibao]'s Articles
[Huang, Lijie]'s Articles
[Du, Changde]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Wang, Haibao]'s Articles
[Huang, Lijie]'s Articles
[Du, Changde]'s Articles
Terms of Use
No data!
Social Bookmark/Share
File name: ijcnn.pdf
Format: Adobe PDF
This file does not support browsing at this time
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.