Knowledge Commons of Institute of Automation,CAS
Image automatic annotation via multi-view deep representation | |
Yang Y(杨阳); Zhang Wensheng(张文生); Xie Yuan; wensheng zhang | |
发表期刊 | Journal of Visual Communication and Image Representation |
2015 | |
卷号 | 2015期号:33页码:368-377 |
摘要 |
The performance of text-based image retrieval is highly dependent on the tedious and inefficient manual work. For the purpose of realizing image keywords generated automatically, extensive work has been done in the area of image annotation. However, how to treat image diverse keywords and choose appropriate features are still two difficult problems. To address this challenge, we propose the multi-view stacked auto-encoder (MVSAE) framework to establish the correlations between the low-level visual features and high-level semantic information. In this paper, a new method, which incorporates the keyword frequencies and log-entropy, is presented to address the imbalanced distribution of keywords. In order to utilize the complementarities among diverse visual descriptors, we tactfully apply multi-view learning to
search for the label-specific features. Thereafter, the image keywords are finally produced by appropriate features. Conducting extensive experiments on three popular data sets, we demonstrate that our proposed framework can achieve effective and favorable performance for image annotation. |
关键词 | Image Annotation Stacked Auto-encoder Imbalance Learning Multi-view Learning Image Features Semantic Gap Deep Learning Multi-labeling |
收录类别 | SCI |
文献类型 | 期刊论文 |
条目标识符 | http://ir.ia.ac.cn/handle/173211/12090 |
专题 | 多模态人工智能系统全国重点实验室_人工智能与机器学习(杨雪冰)-技术团队 |
通讯作者 | wensheng zhang |
作者单位 | Institute of Automation, University of Chinese Academy of Sciences |
推荐引用方式 GB/T 7714 | Yang Y,Zhang Wensheng,Xie Yuan,et al. Image automatic annotation via multi-view deep representation[J]. Journal of Visual Communication and Image Representation,2015,2015(33):368-377. |
APA | Yang Y,Zhang Wensheng,Xie Yuan,&wensheng zhang.(2015).Image automatic annotation via multi-view deep representation.Journal of Visual Communication and Image Representation,2015(33),368-377. |
MLA | Yang Y,et al."Image automatic annotation via multi-view deep representation".Journal of Visual Communication and Image Representation 2015.33(2015):368-377. |
条目包含的文件 | 下载所有文件 | |||||
文件名称/大小 | 文献类型 | 版本类型 | 开放类型 | 使用许可 | ||
Image automatic anno(1988KB) | 期刊论文 | 作者接受稿 | 开放获取 | CC BY-NC-SA | 浏览 下载 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论