CASIA OpenIR  > 模式识别国家重点实验室  > 多媒体计算
Multi-Modal Event Topic Model for Social Event Analysis
Shengsheng Qian1; Tianzhu Zhang1; Changsheng Xu; Jie Shao2

With the massive growth of social events in Internet, it has become more and more difficult to exactly find and organize the interesting events from massive social media data, which is useful to browse, search, and monitor social events by users or governments. To deal with this problem, we propose a novel multi-modal social event tracking and evolution framework to not only effectively capture multi-modal topics of social events, but also obtain the evolutionary trends of social events and generate effective event summary details over time. To achieve this goal, we propose a novel multi-modal event topic model (mmETM), which can effectively model social media documents, including long text with related images, and learn the correlations between textual and visual modalities to separate the visual-representative topics and non-visual-representative topics. To apply the mmETM model to social event tracking, we adopt an incremental learning strategy denoted as incremental mmETM, which can obtain informative textual and visual topics of social events over time to help understand these events and their evolutionary trends. To evaluate the effectiveness of our proposed algorithm, we collect a real-world dataset to conduct various experiments. Both qualitative and quantitative evaluations demonstrate that the proposed mmETM algorithm performs favorably against several state-of-the-art methods.

KeywordEvent Evolution Multi-modality Social Event Tracking Social Media Topic Model
WOS HeadingsScience & Technology ; Technology
Indexed BySCI
Funding OrganizationNational Basic Research Program of China(2012CB316304) ; National Natural Science Foundation of China(61225009 ; Beijing Natural Science Foundation(4131004) ; 61432019 ; 61572498 ; 61303173 ; 61532009 ; 61472115 ; 61472379 ; U1435211 ; 61572296)
WOS Research AreaComputer Science ; Telecommunications
WOS SubjectComputer Science, Information Systems ; Computer Science, Software Engineering ; Telecommunications
WOS IDWOS:000368402400008
Citation statistics
Cited Times:83[WOS]   [WOS Record]     [Related Records in WOS]
Document Type期刊论文
Corresponding AuthorChangsheng Xu
Affiliation1.National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences
2.Big Media Computing Center, School of Computer Science and Engineering, University of Electronic Science and Technology
First Author AffilicationChinese Acad Sci, Inst Automat, Natl Lab Pattern Recognit, Beijing 100190, Peoples R China
Recommended Citation
GB/T 7714
Shengsheng Qian,Tianzhu Zhang,Changsheng Xu,et al. Multi-Modal Event Topic Model for Social Event Analysis[J]. IEEE TRANSACTIONS ON MULTIMEDIA,2016,18(2):233-246.
APA Shengsheng Qian,Tianzhu Zhang,Changsheng Xu,&Jie Shao.(2016).Multi-Modal Event Topic Model for Social Event Analysis.IEEE TRANSACTIONS ON MULTIMEDIA,18(2),233-246.
MLA Shengsheng Qian,et al."Multi-Modal Event Topic Model for Social Event Analysis".IEEE TRANSACTIONS ON MULTIMEDIA 18.2(2016):233-246.
Files in This Item: Download All
File Name/Size DocType Version Access License
TMM2016_Multi-Modal (3335KB)期刊论文作者接受稿开放获取CC BY-NC-SAView Download
Related Services
Recommend this item
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Shengsheng Qian]'s Articles
[Tianzhu Zhang]'s Articles
[Changsheng Xu]'s Articles
Baidu academic
Similar articles in Baidu academic
[Shengsheng Qian]'s Articles
[Tianzhu Zhang]'s Articles
[Changsheng Xu]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Shengsheng Qian]'s Articles
[Tianzhu Zhang]'s Articles
[Changsheng Xu]'s Articles
Terms of Use
No data!
Social Bookmark/Share
File name: TMM2016_Multi-Modal Event Topic Model for Social Event Analysis.pdf
Format: Adobe PDF
This file does not support browsing at this time
All comments (0)
No comment.

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.