Deep Structured Event Modeling for User-Generated Photos
Yang, Xiaoshan1,2; Zhang, Tianzhu1,2; Xu, Changsheng1,2
发表期刊IEEE TRANSACTIONS ON MULTIMEDIA
2018
卷号20期号:8页码:2100-2113
摘要Vision based event analysis plays a very critical role in automatically organizing user generated photos. It is difficult because of the following challenges. (1) Intra-class variation. Photos uploaded by users are sparsely sampled visual appearances of event over time. Thus, each photo may only capture a single object or scene of a specific complex event. (2) Inter-class confusion. Photos related to different events may contain similar objects or scenes. (3) For abnormal event, it has sample scarcity issue and only few samples can be used for event pattern learning. In this paper, by considering the photo taken time, we propose a novel structured event modeling (SEM) framework for event analysis by exploiting temporal information of visual features and event classes in photo sequence. More specifically, the temporal event patterns of the photo sequence and the relationship of different photos are learned jointly through deep neural networks (CNNs and RNNs) and conditional random field (CRF). We evaluate the proposed structured event modeling framework in two applications including the mutliclass event recognition and abnormal event discovery in photo sequence. The extensive experimental results on a public event recognition dataset and a collected abnormal event dataset demonstrate the effectiveness of the proposed method.
关键词Event Analysis Unusual Event Detection Deep Learning
DOI10.1109/TMM.2017.2788210
收录类别SCI
语种英语
引用统计
文献类型期刊论文
条目标识符http://ir.ia.ac.cn/handle/173211/19702
专题模式识别国家重点实验室_多媒体计算与图形学
作者单位1.National Lab of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences
2.University of Chinese Academy of Sciences
推荐引用方式
GB/T 7714
Yang, Xiaoshan,Zhang, Tianzhu,Xu, Changsheng. Deep Structured Event Modeling for User-Generated Photos[J]. IEEE TRANSACTIONS ON MULTIMEDIA,2018,20(8):2100-2113.
APA Yang, Xiaoshan,Zhang, Tianzhu,&Xu, Changsheng.(2018).Deep Structured Event Modeling for User-Generated Photos.IEEE TRANSACTIONS ON MULTIMEDIA,20(8),2100-2113.
MLA Yang, Xiaoshan,et al."Deep Structured Event Modeling for User-Generated Photos".IEEE TRANSACTIONS ON MULTIMEDIA 20.8(2018):2100-2113.
条目包含的文件 下载所有文件
文件名称/大小 文献类型 版本类型 开放类型 使用许可
Deep-Structured Even(1164KB)期刊论文作者接受稿开放获取CC BY-NC-SA浏览 下载
个性服务
推荐该条目
保存到收藏夹
查看访问统计
导出为Endnote文件
谷歌学术
谷歌学术中相似的文章
[Yang, Xiaoshan]的文章
[Zhang, Tianzhu]的文章
[Xu, Changsheng]的文章
百度学术
百度学术中相似的文章
[Yang, Xiaoshan]的文章
[Zhang, Tianzhu]的文章
[Xu, Changsheng]的文章
必应学术
必应学术中相似的文章
[Yang, Xiaoshan]的文章
[Zhang, Tianzhu]的文章
[Xu, Changsheng]的文章
相关权益政策
暂无数据
收藏/分享
文件名: Deep-Structured Event Modeling.pdf
格式: Adobe PDF
所有评论 (0)
暂无评论
 

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。