A three-level framework for affective content analysis and its case studies

	A three-level framework for affective content analysis and its case studies
	Xu, Min 1,2; Wang, Jinqiao2 ; He, Xiangjian 1; Jin, Jesse S.3; Luo, Suhuai 3; Lu, Hanqing2
发表期刊	MULTIMEDIA TOOLS AND APPLICATIONS
	2014-05-01
卷号	70 期号:2 页码:757-779
文章类型	Article
摘要	Emotional factors directly reflect audiences' attention, evaluation and memory. Recently, video affective content analysis attracts more and more research efforts. Most of the existing methods map low-level affective features directly to emotions by applying machine learning. Compared to human perception process, there is actually a gap between low-level features and high-level human perception of emotion. In order to bridge the gap, we propose a three-level affective content analysis framework by introducing mid-level representation to indicate dialog, audio emotional events (e. g., horror sounds and laughters) and textual concepts (e.g., informative keywords). Mid-level representation is obtained from machine learning on low-level features and used to infer high-level affective content. We further apply the proposed framework and focus on a number of case studies. Audio emotional event, dialog and subtitle are studied to assist affective content detection in different video domains/genres. Multiple modalities are considered for affective analysis, since different modality has its own merit to evoke emotions. Experimental results shows the proposed framework is effective and efficient for affective content analysis. Audio emotional event, dialog and subtitle are promising mid-level representations.
关键词	Affective Content Analysis Mid-level Representation Multiple Modality
WOS标题词	Science & Technology ; Technology
关键词[WOS]	VIDEO ; RECOGNITION ; RETRIEVAL ; FILM
收录类别	SCI
语种	英语
WOS研究方向	Computer Science ; Engineering
WOS类目	Computer Science, Information Systems ; Computer Science, Software Engineering ; Computer Science, Theory & Methods ; Engineering, Electrical & Electronic
WOS记录号	WOS:000336995900009
引用统计	被引频次：28[WOS] [WOS记录] [WOS相关记录]
文献类型	期刊论文
条目标识符	http://ir.ia.ac.cn/handle/173211/3361
专题	紫东太初大模型研究中心_图像与视频分析
通讯作者	Wang, Jinqiao
作者单位	1.Univ Technol Sydney, Ctr Innovat IT Serv & Applicat, Sydney, NSW 2007, Australia 2.Chinese Acad Sci, Inst Automat, Natl Lab Pattern Recognit, Beijing, Peoples R China 3.Univ Newcastle, Sch Design Commun & IT, Callaghan, NSW 2308, Australia
第一作者单位	模式识别国家重点实验室
通讯作者单位	模式识别国家重点实验室
推荐引用方式 GB/T 7714	Xu, Min,Wang, Jinqiao,He, Xiangjian,et al. A three-level framework for affective content analysis and its case studies[J]. MULTIMEDIA TOOLS AND APPLICATIONS,2014,70(2):757-779.
APA	Xu, Min,Wang, Jinqiao,He, Xiangjian,Jin, Jesse S.,Luo, Suhuai,&Lu, Hanqing.(2014).A three-level framework for affective content analysis and its case studies.MULTIMEDIA TOOLS AND APPLICATIONS,70(2),757-779.
MLA	Xu, Min,et al."A three-level framework for affective content analysis and its case studies".MULTIMEDIA TOOLS AND APPLICATIONS 70.2(2014):757-779.

条目包含的文件		下载所有文件
文件名称/大小	文献类型	版本类型	开放类型	使用许可
A three-level framew（1133KB）	期刊论文	作者接受稿	开放获取	CC BY-NC-SA	浏览