Institutional Repository of Chinese Acad Sci, Inst Automat, Natl Lab Pattern Recognit, Beijing 100190, Peoples R China
Exploiting Visual-Audio-Textual Characteristics for Automatic TV Commercial Block Detection and Segmentation | |
Liu, Nan1,2; Zhao, Yao1,2; Zhu, Zhenfeng1,2; Lu, Hanqing3 | |
发表期刊 | IEEE TRANSACTIONS ON MULTIMEDIA |
2011-10-01 | |
卷号 | 13期号:5页码:961-973 |
文章类型 | Article |
摘要 | Automatic TV commercial block detection (CBD) and commercial block segmentation (CBS) are two key components of a smart commercial digesting system. In this paper, we focus our research on CBD and CBS by the means of collaborative exploitation of visual-audio-textual characteristics embedded in commercials. Rather than utilizing exclusively visual-audio characteristics like most previous works, an abundance of textual characteristics associated with commercials are fully exploited. Additionally, Tri-AdaBoost, an interactive ensemble learning manner, is proposed to form a consolidated semantic fusion across visual, audio, and textual characteristics. In order to segment a detected commercial block into multiple individual commercials, additional informative descriptors including textual characteristics are introduced to boost the robustness in the detection of frame marked with product information (FMPI). Together with the characteristics of audio spectral variation pointer and silent position, FMPI can provide a kind of complementary representation architecture to model the similarity of intra-commercial and the dissimilarity of inter-commercial. Experiments are conducted on a large video dataset from both China central television (CCTV) channels and TRECVID'05, and promising experimental results show the effectiveness of the proposed scheme. |
关键词 | Commercial Detection Commercial Segmentation Multi-modal Fusion Text Detection Video Analysis |
WOS标题词 | Science & Technology ; Technology |
关键词[WOS] | VIDEO ; STREAMS |
收录类别 | SCI |
语种 | 英语 |
WOS研究方向 | Computer Science ; Telecommunications |
WOS类目 | Computer Science, Information Systems ; Computer Science, Software Engineering ; Telecommunications |
WOS记录号 | WOS:000295007300011 |
引用统计 | |
文献类型 | 期刊论文 |
条目标识符 | http://ir.ia.ac.cn/handle/173211/3329 |
专题 | 模式识别国家重点实验室_图像与视频分析 |
作者单位 | 1.Beijing Jiaotong Univ, Inst Informat Sci, Beijing 100044, Peoples R China 2.Beijing Key Lab Adv Informat Sci & Network Techno, Beijing 100044, Peoples R China 3.Chinese Acad Sci, Inst Automat, Beijing 100080, Peoples R China |
推荐引用方式 GB/T 7714 | Liu, Nan,Zhao, Yao,Zhu, Zhenfeng,et al. Exploiting Visual-Audio-Textual Characteristics for Automatic TV Commercial Block Detection and Segmentation[J]. IEEE TRANSACTIONS ON MULTIMEDIA,2011,13(5):961-973. |
APA | Liu, Nan,Zhao, Yao,Zhu, Zhenfeng,&Lu, Hanqing.(2011).Exploiting Visual-Audio-Textual Characteristics for Automatic TV Commercial Block Detection and Segmentation.IEEE TRANSACTIONS ON MULTIMEDIA,13(5),961-973. |
MLA | Liu, Nan,et al."Exploiting Visual-Audio-Textual Characteristics for Automatic TV Commercial Block Detection and Segmentation".IEEE TRANSACTIONS ON MULTIMEDIA 13.5(2011):961-973. |
条目包含的文件 | 条目无相关文件。 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论