Knowledge Commons of Institute of Automation,CAS
A three-level framework for affective content analysis and its case studies | |
Xu, Min1,2; Wang, Jinqiao2; He, Xiangjian1; Jin, Jesse S.3; Luo, Suhuai3; Lu, Hanqing2 | |
发表期刊 | MULTIMEDIA TOOLS AND APPLICATIONS |
2014-05-01 | |
卷号 | 70期号:2页码:757-779 |
文章类型 | Article |
摘要 | Emotional factors directly reflect audiences' attention, evaluation and memory. Recently, video affective content analysis attracts more and more research efforts. Most of the existing methods map low-level affective features directly to emotions by applying machine learning. Compared to human perception process, there is actually a gap between low-level features and high-level human perception of emotion. In order to bridge the gap, we propose a three-level affective content analysis framework by introducing mid-level representation to indicate dialog, audio emotional events (e. g., horror sounds and laughters) and textual concepts (e.g., informative keywords). Mid-level representation is obtained from machine learning on low-level features and used to infer high-level affective content. We further apply the proposed framework and focus on a number of case studies. Audio emotional event, dialog and subtitle are studied to assist affective content detection in different video domains/genres. Multiple modalities are considered for affective analysis, since different modality has its own merit to evoke emotions. Experimental results shows the proposed framework is effective and efficient for affective content analysis. Audio emotional event, dialog and subtitle are promising mid-level representations. |
关键词 | Affective Content Analysis Mid-level Representation Multiple Modality |
WOS标题词 | Science & Technology ; Technology |
关键词[WOS] | VIDEO ; RECOGNITION ; RETRIEVAL ; FILM |
收录类别 | SCI |
语种 | 英语 |
WOS研究方向 | Computer Science ; Engineering |
WOS类目 | Computer Science, Information Systems ; Computer Science, Software Engineering ; Computer Science, Theory & Methods ; Engineering, Electrical & Electronic |
WOS记录号 | WOS:000336995900009 |
引用统计 | |
文献类型 | 期刊论文 |
条目标识符 | http://ir.ia.ac.cn/handle/173211/3361 |
专题 | 紫东太初大模型研究中心_图像与视频分析 |
通讯作者 | Wang, Jinqiao |
作者单位 | 1.Univ Technol Sydney, Ctr Innovat IT Serv & Applicat, Sydney, NSW 2007, Australia 2.Chinese Acad Sci, Inst Automat, Natl Lab Pattern Recognit, Beijing, Peoples R China 3.Univ Newcastle, Sch Design Commun & IT, Callaghan, NSW 2308, Australia |
第一作者单位 | 模式识别国家重点实验室 |
通讯作者单位 | 模式识别国家重点实验室 |
推荐引用方式 GB/T 7714 | Xu, Min,Wang, Jinqiao,He, Xiangjian,et al. A three-level framework for affective content analysis and its case studies[J]. MULTIMEDIA TOOLS AND APPLICATIONS,2014,70(2):757-779. |
APA | Xu, Min,Wang, Jinqiao,He, Xiangjian,Jin, Jesse S.,Luo, Suhuai,&Lu, Hanqing.(2014).A three-level framework for affective content analysis and its case studies.MULTIMEDIA TOOLS AND APPLICATIONS,70(2),757-779. |
MLA | Xu, Min,et al."A three-level framework for affective content analysis and its case studies".MULTIMEDIA TOOLS AND APPLICATIONS 70.2(2014):757-779. |
条目包含的文件 | 下载所有文件 | |||||
文件名称/大小 | 文献类型 | 版本类型 | 开放类型 | 使用许可 | ||
A three-level framew(1133KB) | 期刊论文 | 作者接受稿 | 开放获取 | CC BY-NC-SA | 浏览 下载 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论