CASIA OpenIR  > 模式识别国家重点实验室  > 机器人视觉
Statistics of Visual Responses to Image Object Stimuli from Primate AIT Neurons to DNN Neurons
Dong, Qiulei1,2,3; Wang, Hong2; Hu, Zhanyi1,2,3
Source PublicationNEURAL COMPUTATION
2018-02-01
Volume30Issue:2Pages:447-476
SubtypeArticle
AbstractUnder the goal-driven paradigm, Yamins etal. (2014; Yamins & DiCarlo, 2016) have shown that by optimizing only the final eight-way categorization performance of a four-layer hierarchical network, not only can its top output layer quantitatively predict IT neuron responses but its penultimate layer can also automatically predict V4 neuron responses. Currently, deep neural networks (DNNs) in the field of computer vision have reached image object categorization performance comparable to that of human beings on ImageNet, a data set that contains 1.3 million training images of 1000 categories. We explore whether the DNN neurons (units in DNNs) possess image object representational statistics similar to monkey IT neurons, particularly when the network becomes deeper and the number of image categories becomes larger, using VGG19, a typical and widely used deep network of 19 layers in the computer vision field. Following Lehky, Kiani, Esteky, and Tanaka (2011, 2014), where the response statistics of 674 IT neurons to 806 image stimuli are analyzed using three measures (kurtosis, Pareto tail index, and intrinsic dimensionality), we investigate the three issues in this letter using the same three measures: (1) the similarities and differences of the neural response statistics between VGG19 and primate IT cortex, (2) the variation trends of the response statistics of VGG19 neurons at different layers from low to high, and (3) the variation trends of the response statistics of VGG19 neurons when the numbers of stimuli and neurons increase. We find that the response statistics on both single-neuron selectivity and population sparseness of VGG19 neurons are fundamentally different from those of IT neurons in most cases; by increasing the number of neurons in different layers and the number of stimuli, the response statistics of neurons at different layers from low to high do not substantially change; and the estimated intrinsic dimensionality values at the low convolutional layers of VGG19 are considerably larger than the value of approximately 100 reported for IT neurons in Lehky etal. (2014), whereas those at the high fully connected layers are close to or lower than 100. To the best of our knowledge, this work is the first attempt to analyze the response statistics of DNN neurons with respect to primate IT neurons in image object representation.
WOS HeadingsScience & Technology ; Technology ; Life Sciences & Biomedicine
DOI10.1162/neco_a_01039
WOS KeywordINFEROTEMPORAL CORTEX ; TEMPORAL CORTEX ; SPARSENESS ; DIMENSIONALITY ; RECOGNITION ; SELECTIVITY ; MODELS ; SPACE
Indexed BySCI
Language英语
Funding OrganizationStrategic Priority Research Program of the Chinese Academy of Sciences(XDB02070002) ; National Natural Science Foundation of China(61421004 ; 61375042 ; 61573359 ; 61672489)
WOS Research AreaComputer Science ; Neurosciences & Neurology
WOS SubjectComputer Science, Artificial Intelligence ; Neurosciences
WOS IDWOS:000423043500006
Citation statistics
Cited Times:2[WOS]   [WOS Record]     [Related Records in WOS]
Document Type期刊论文
Identifierhttp://ir.ia.ac.cn/handle/173211/21938
Collection模式识别国家重点实验室_机器人视觉
Affiliation1.Chinese Acad Sci, Inst Automat, Natl Lab Pattern Recognit, Beijing 100190, Peoples R China
2.Univ Chinese Acad Sci, Beijing 100049, Peoples R China
3.CAS Ctr Excellence Brain Sci & Intelligence Techn, Beijing 100190, Peoples R China
Recommended Citation
GB/T 7714
Dong, Qiulei,Wang, Hong,Hu, Zhanyi. Statistics of Visual Responses to Image Object Stimuli from Primate AIT Neurons to DNN Neurons[J]. NEURAL COMPUTATION,2018,30(2):447-476.
APA Dong, Qiulei,Wang, Hong,&Hu, Zhanyi.(2018).Statistics of Visual Responses to Image Object Stimuli from Primate AIT Neurons to DNN Neurons.NEURAL COMPUTATION,30(2),447-476.
MLA Dong, Qiulei,et al."Statistics of Visual Responses to Image Object Stimuli from Primate AIT Neurons to DNN Neurons".NEURAL COMPUTATION 30.2(2018):447-476.
Files in This Item:
There are no files associated with this item.
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Dong, Qiulei]'s Articles
[Wang, Hong]'s Articles
[Hu, Zhanyi]'s Articles
Baidu academic
Similar articles in Baidu academic
[Dong, Qiulei]'s Articles
[Wang, Hong]'s Articles
[Hu, Zhanyi]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Dong, Qiulei]'s Articles
[Wang, Hong]'s Articles
[Hu, Zhanyi]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.