Multi-View Image Classification With Visual, Semantic and View Consistency

doi:10.1109/TIP.2019.2934576

	Multi-View Image Classification With Visual, Semantic and View Consistency
	Zhang, Chunjie1 ; Cheng, Jian2,3,4 ; Tian, Qi 5
发表期刊	IEEE TRANSACTIONS ON IMAGE PROCESSING
ISSN	1057-7149
	2020
卷号	29 页码:617-627
通讯作者	Zhang, Chunjie(cjzhang@bjtu.edu.cn)
摘要	Multi-view visual classification methods have been widely applied to use discriminative information of different views. This strategy has been proven very effective by many researchers. On the one hand, images are often treated independently without fully considering their visual and semantic correlations. On the other hand, view consistency is often ignored. To solve these problems, in this paper, we propose a novel multi-view image classification method with visual, semantic and view consistency (VSVC). For each image, we linearly combine multi-view information for image classification. The combination parameters are determined by considering both the classification loss and the visual, semantic and view consistency. Visual consistency is imposed by ensuring that visually similar images of the same view are predicted to have similar values. For semantic consistency, we impose the locality constraint that nearby images should be predicted to have the same class by multi-view combination. View consistency is also used to ensure that similar images have consistent multi-view combination parameters. An alternative optimization strategy is used to learn the combination parameters. To evaluate the effectiveness of VSVC, we perform image classification experiments on several public datasets. The experimental results on these datasets show the effectiveness of the proposed VSVC method.
关键词	Semantics Visualization Correlation Training Internet Encoding Image representation Multi-view learning image classification visual consistency semantic consistency view consistency
DOI	10.1109/TIP.2019.2934576
关键词[WOS]	LOW-RANK ; REPRESENTATION ; FEATURES
收录类别	SCI
语种	英语
资助项目	Fundamental Research Funds for the Central Universities[2019RC040] ; National Science Foundation of China (NSFC)[61872362] ; Beijing Municipal Science and Technology Commission[Z181100008918012] ; Fundamental Research Funds for the Central Universities[2019RC040] ; National Science Foundation of China (NSFC)[61872362] ; Beijing Municipal Science and Technology Commission[Z181100008918012]
项目资助者	Fundamental Research Funds for the Central Universities ; National Science Foundation of China (NSFC) ; Beijing Municipal Science and Technology Commission
WOS研究方向	Computer Science ; Engineering
WOS类目	Computer Science, Artificial Intelligence ; Engineering, Electrical & Electronic
WOS记录号	WOS:000497434700027
出版者	IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
引用统计	被引频次：26[WOS] [WOS记录] [WOS相关记录]
文献类型	期刊论文
条目标识符	http://ir.ia.ac.cn/handle/173211/29394
专题	复杂系统认知与决策实验室_高效智能计算与学习
通讯作者	Zhang, Chunjie
作者单位	1.Beijing Jiaotong Univ, Inst Informat Sci, Beijing 100044, Peoples R China 2.Chinese Acad Sci, Inst Automat, Natl Lab Pattern Recognit, Beijing 250014, Peoples R China 3.Univ Chinese Acad Sci, Beijing 100049, Peoples R China 4.Chinese Acad Sci, Ctr Excellence Brain Sci & Intelligence Technol, Beijing 250014, Peoples R China 5.Univ Texas San Antonio, Dept Comp Sci, San Antonio, TX 78249 USA
推荐引用方式 GB/T 7714	Zhang, Chunjie,Cheng, Jian,Tian, Qi. Multi-View Image Classification With Visual, Semantic and View Consistency[J]. IEEE TRANSACTIONS ON IMAGE PROCESSING,2020,29:617-627.
APA	Zhang, Chunjie,Cheng, Jian,&Tian, Qi.(2020).Multi-View Image Classification With Visual, Semantic and View Consistency.IEEE TRANSACTIONS ON IMAGE PROCESSING,29,617-627.
MLA	Zhang, Chunjie,et al."Multi-View Image Classification With Visual, Semantic and View Consistency".IEEE TRANSACTIONS ON IMAGE PROCESSING 29(2020):617-627.