Metadata Connector: Exploiting Hashtag and Tag for Cross-OSN Event Search

doi:10.1109/TMM.2020.2982047

	Metadata Connector: Exploiting Hashtag and Tag for Cross-OSN Event Search
	Gao, Yuqi 1; Sang, Jitao 2,3; Fu, Chengpeng 2,3; Wang, Zhengjia 2,3; Ren, Tongwei 1; Xu, Changsheng4
发表期刊	IEEE TRANSACTIONS ON MULTIMEDIA
ISSN	1520-9210
	2021
卷号	23 页码:510-523
通讯作者	Sang, Jitao(jtsang@bjtu.edu.cn)
摘要	Social media has revolutionized the way people understand and keep track of real-world events. Various related multimedia information in different modalities such as texts, images and videos is updated on social media and reflects the events. These quantities of information distributes on different Online Social Networks (OSNs), which provides rich, wide coverage, comprehensive information about the trending events. Faced with such large amounts of data, searching has become a handy tool for event understanding and tracking on social media. However, existing single-OSN search mainly involves with single modality on single platform. Moreover, most OSNs usually focus on biased perspective of events, which significantly limits the coverage and diversity of single-OSN based event search. In this paper, we introduce a novel cross-OSN framework to help integrate these cross-OSN information regarding the same event and provide an immersive experience for information retrieval. Since social media information is widely distributed in different OSNs where semantic gap exists among these heterogeneous spaces, we propose to utilize hashtag and tag, which are user-generated metadata for organizing and labeling in many OSNs, as bridges to connect between different OSNs. In our four-stage solution framework, various methods are adopted for hashtag and tag filtering, search results representation, clustering and demonstration. Given an event query, in the first stage we generate related items with corresponding tags and hashtags from OSNs and filter the hashtags and tags we need. Then, topical representation is generated for hashtag and tag. The third stage leverages the derived representation for cross-OSN hashtag and tag clustering. Finally, demonstration for each query is produced and the results are organized hierarchically. Experiments on a dataset containing hundreds of search queries and related items demonstrate the effectiveness of our cross-OSN event search framework.
关键词	Twitter Tagging Videos YouTube Flickr Games Social media search cross-OSN application social multimedia
DOI	10.1109/TMM.2020.2982047
关键词[WOS]	ENGINE
收录类别	SCI
语种	英语
资助项目	National Key R&D Program of China[2018AAA0100604] ; National Natural Science Foundation of China[61832002] ; National Natural Science Foundation of China[61632004] ; National Natural Science Foundation of China[61672518] ; National Natural Science Foundation of China[61602115] ; Natural Science Foundation of Jiangsu Province[BK20191248] ; Science, Technology and Innovation Commission of Shenzhen Municipality[JCYJ20180307151516166]
项目资助者	National Key R&D Program of China ; National Natural Science Foundation of China ; Natural Science Foundation of Jiangsu Province ; Science, Technology and Innovation Commission of Shenzhen Municipality
WOS研究方向	Computer Science ; Telecommunications
WOS类目	Computer Science, Information Systems ; Computer Science, Software Engineering ; Telecommunications
WOS记录号	WOS:000601877600040
出版者	IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
引用统计	被引频次：3[WOS] [WOS记录] [WOS相关记录]
文献类型	期刊论文
条目标识符	http://ir.ia.ac.cn/handle/173211/42799
专题	多模态人工智能系统全国重点实验室_多媒体计算
通讯作者	Sang, Jitao
作者单位	1.Nanjing Univ, State Key Lab Novel Software Technol, Nanjing 210093, Peoples R China 2.Beijing Jiaotong Univ, Sch Comp & Informat Technol, Beijing 100044, Peoples R China 3.Beijing Jiaotong Univ, Beijing Key Lab Traff Data Anal & Min, Beijing 100044, Peoples R China 4.Chinese Acad Sci, Inst Automat, Natl Lab Pattern Recognit, Beijing 100190, Peoples R China
推荐引用方式 GB/T 7714	Gao, Yuqi,Sang, Jitao,Fu, Chengpeng,et al. Metadata Connector: Exploiting Hashtag and Tag for Cross-OSN Event Search[J]. IEEE TRANSACTIONS ON MULTIMEDIA,2021,23:510-523.
APA	Gao, Yuqi,Sang, Jitao,Fu, Chengpeng,Wang, Zhengjia,Ren, Tongwei,&Xu, Changsheng.(2021).Metadata Connector: Exploiting Hashtag and Tag for Cross-OSN Event Search.IEEE TRANSACTIONS ON MULTIMEDIA,23,510-523.
MLA	Gao, Yuqi,et al."Metadata Connector: Exploiting Hashtag and Tag for Cross-OSN Event Search".IEEE TRANSACTIONS ON MULTIMEDIA 23(2021):510-523.