Discriminative multimodal embedding for event classification

doi:10.1016/j.neucom.2017.11.078

	Discriminative multimodal embedding for event classification
	Qi, Fan 1,4; Yang, Xiaoshan2,3,4 ; Zhang, Tianzhu2,3 ; Xu, Changsheng1,2,3,4
发表期刊	NEUROCOMPUTING
ISSN	0925-2312
	2020-06-28
卷号	395 页码:160-169
通讯作者	Yang, Xiaoshan(xiaoshan.yang@nlpr.ia.ac.cn)
摘要	Most of existing multimodal event classification methods fuse the traditional hand-crafted features with some manually defined weights, which may be not suitable to the event classification task with large amounts of photos. Besides, the feature extraction and event classification model are always performed separately, which cannot capture the most useful features to describe the semantic concepts of complex events. To deal with these issues, we propose a novel discriminative multimodal embedding (DME) model for event classification in user generated photos by jointly learning the representation together with the classifier in a unified framework. In the proposed DME model, we can effectively resolve the multimodal, intra-class variation and inter-class confusion challenges by using the contrastive constraints on the multimodal event data. Extensive experimental results on two collected datasets demonstrate the effectiveness of the proposed DME model for event classification. (C) 2019 Elsevier B.V. All rights reserved.
关键词	Social media Event classification Multimodal embedding
DOI	10.1016/j.neucom.2017.11.078
关键词[WOS]	IMAGE ANNOTATION
收录类别	SCI
语种	英语
资助项目	National Key Research and Development Program of China[2017YFB1002804] ; National Natural Science Foundation of China[61702511] ; National Natural Science Foundation of China[6172010 6006] ; National Natural Science Foundation of China[61728210] ; National Natural Science Foundation of China[61751211] ; National Natural Science Foundation of China[61620106003] ; National Natural Science Foundation of China[61632007] ; National Natural Science Foundation of China[61532009] ; National Natural Science Foundation of China[61572498] ; National Natural Science Foundation of China[61572296] ; National Natural Science Foundation of China[61432019] ; National Natural Science Foundation of China[U1836220] ; National Natural Science Foundation of China[U1705262] ; Key Research Program of Frontier Sciences, CAS[QYZDJSSWJSC039] ; Research Program of National Laboratory of Pattern Recognition[Z-2018007] ; CCF-Tencent Open Fund
项目资助者	National Key Research and Development Program of China ; National Natural Science Foundation of China ; Key Research Program of Frontier Sciences, CAS ; Research Program of National Laboratory of Pattern Recognition ; CCF-Tencent Open Fund
WOS研究方向	Computer Science
WOS类目	Computer Science, Artificial Intelligence
WOS记录号	WOS:000536809600016
出版者	ELSEVIER
七大方向——子方向分类	多模态智能
引用统计	被引频次：2[WOS] [WOS记录] [WOS相关记录]
文献类型	期刊论文
条目标识符	http://ir.ia.ac.cn/handle/173211/39545
专题	多模态人工智能系统全国重点实验室_多媒体计算
通讯作者	Yang, Xiaoshan
作者单位	1.Hefei Univ Technoloy, Sch Comp & Informat, Hefei, Peoples R China 2.Chinese Acad Sci, Inst Automat, Beijing 100190, Peoples R China 3.Univ Chinese Acad Sci, Beijing 100190, Peoples R China 4.Peng Cheng Lab, Shenzhen, Peoples R China
通讯作者单位	中国科学院自动化研究所
推荐引用方式 GB/T 7714	Qi, Fan,Yang, Xiaoshan,Zhang, Tianzhu,et al. Discriminative multimodal embedding for event classification[J]. NEUROCOMPUTING,2020,395:160-169.
APA	Qi, Fan,Yang, Xiaoshan,Zhang, Tianzhu,&Xu, Changsheng.(2020).Discriminative multimodal embedding for event classification.NEUROCOMPUTING,395,160-169.
MLA	Qi, Fan,et al."Discriminative multimodal embedding for event classification".NEUROCOMPUTING 395(2020):160-169.