@ICT: attention-based virtual content insertion

	@ICT: attention-based virtual content insertion
	Liu, Huiying 1; Huang, Qingming 2; Xu, Changsheng3 ; Jiang, Shuqiang 1
发表期刊	MULTIMEDIA SYSTEMS
	2012-06-01
卷号	18 期号:3 页码:201-214
文章类型	Article
摘要	In this paper, we propose an attention-based virtual content insertion solution, called @ICT. Virtual content insertion (VCI) is an emerging application of video analysis and has been used in video augmentation and advertisement insertion. An ideal VCI solution should make the inserted virtual content being noticed by audiences and at the same time should not interfere with audiences' viewing experience on the original content. To balance these two conflicting issues, meaning high attention and low intrusiveness, we choose higher attentive shots as insertion time while determine insertion place and content interdependently by considering lower attention together with visual consistency. We also propose a measurement of intrusiveness from the viewpoint of visual attention. Furthermore, @ICT includes an in-scene insertion module, which embeds the virtual content into the videos with higher vividness and lower intrusiveness. @ICT is able to obtain an optimal balance between the noticing of the virtual content by audiences and disruption of viewing experience to the original content. It needs little prior knowledge and is applied to general videos. Extensive quantitative and qualitative evaluations on the VCI result have verified the effectiveness of the solution.
关键词	Video Content Analysis Virtual Content Insertion Visual Attention
WOS标题词	Science & Technology ; Technology
关键词[WOS]	RECEPTIVE-FIELDS ; NATURAL SCENES ; VIDEO ; MODEL ; FRAMEWORK
收录类别	SCI
语种	英语
WOS研究方向	Computer Science
WOS类目	Computer Science, Information Systems ; Computer Science, Theory & Methods
WOS记录号	WOS:000304565800001
引用统计	被引频次：1[WOS] [WOS记录] [WOS相关记录]
文献类型	期刊论文
条目标识符	http://ir.ia.ac.cn/handle/173211/2788
专题	多模态人工智能系统全国重点实验室_多媒体计算
作者单位	1.Chinese Acad Sci, Key Lab Intelligent Informat Proc, Inst Comp Technol, Beijing 100190, Peoples R China 2.Chinese Acad Sci, Grad Univ, Beijing 100049, Peoples R China 3.Chinese Acad Sci, Inst Automat, Natl Lab Pattern Recognit, Beijing 100190, Peoples R China
推荐引用方式 GB/T 7714	Liu, Huiying,Huang, Qingming,Xu, Changsheng,et al. @ICT: attention-based virtual content insertion[J]. MULTIMEDIA SYSTEMS,2012,18(3):201-214.
APA	Liu, Huiying,Huang, Qingming,Xu, Changsheng,&Jiang, Shuqiang.(2012).@ICT: attention-based virtual content insertion.MULTIMEDIA SYSTEMS,18(3),201-214.
MLA	Liu, Huiying,et al."@ICT: attention-based virtual content insertion".MULTIMEDIA SYSTEMS 18.3(2012):201-214.