Knowledge Commons of Institute of Automation,CAS
Content-Based Visual Summarization for Image Collections | |
Pan, Xingjia1,2![]() ![]() ![]() | |
发表期刊 | IEEE Transactions on Visualization and Computer Graphics
![]() |
2019-10-23 | |
期号 | 0页码:1-1 |
摘要 | With the surge of images in the information era, people demand an effective and accurate way to access meaningful visual information. Accordingly, effective and accurate communication of information has become indispensable. In this work, we propose a content-based approach that automatically generates a clear and informative visual summarization based on design principles and cognitive psychology to represent image collections. We first introduce a novel method to make representative and nonredundant summarizations of image collections, thereby ensuring data cleanliness and emphasizing important information. Then, we propose a tree-based algorithm with a two-step optimization strategy to generate the final layout that operates as follows: (1) an initial layout is created by constructing a tree randomly based on the grouping results of the input image set; (2) the layout is refined through a coarse adjustment in a greedy manner, followed by gradient backpropagation drawing on the training procedure of neural networks. We demonstrate the usefulness and effectiveness of our method via extensive experimental results and user studies. Our visual summarization algorithm can precisely and efficiently capture the main content of image collections better than alternative methods or commercial tools. |
关键词 | Collage layout hidden-topic tree-based content-aware summeration |
学科门类 | 工学 |
DOI | 10.1109/TVCG.2019.2948611 |
收录类别 | SCI |
语种 | 英语 |
WOS记录号 | WOS:000623420400004 |
七大方向——子方向分类 | 图像视频处理与分析 |
引用统计 | |
文献类型 | 期刊论文 |
条目标识符 | http://ir.ia.ac.cn/handle/173211/41614 |
专题 | 多模态人工智能系统全国重点实验室_多媒体计算 |
通讯作者 | Dong, Weiming |
作者单位 | 1.NLPR, Institute of Automation, Chinese Academy of Sciences 2.University of Chinese Academy of Sciences 3.Jilin University 4.Youtu Lab, Tencent 5.National Cheng-Kung University 6.YLab, Kuaishou Technology 7.Didi Chuxing |
第一作者单位 | 模式识别国家重点实验室 |
通讯作者单位 | 模式识别国家重点实验室 |
推荐引用方式 GB/T 7714 | Pan, Xingjia,Tang, Fan,Dong, Weiming,et al. Content-Based Visual Summarization for Image Collections[J]. IEEE Transactions on Visualization and Computer Graphics,2019(0):1-1. |
APA | Pan, Xingjia.,Tang, Fan.,Dong, Weiming.,Ma, Chongyang.,Meng, Yiping.,...&Xu, Changsheng.(2019).Content-Based Visual Summarization for Image Collections.IEEE Transactions on Visualization and Computer Graphics(0),1-1. |
MLA | Pan, Xingjia,et al."Content-Based Visual Summarization for Image Collections".IEEE Transactions on Visualization and Computer Graphics .0(2019):1-1. |
条目包含的文件 | 下载所有文件 | |||||
文件名称/大小 | 文献类型 | 版本类型 | 开放类型 | 使用许可 | ||
VisualSum.pdf(26249KB) | 期刊论文 | 作者接受稿 | 开放获取 | CC BY-NC-SA | 浏览 下载 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论