Institutional Repository of Chinese Acad Sci, Inst Automat, Natl Lab Pattern Recognit, Beijing 100190, Peoples R China
Knowing Verb From Object: Retagging With Transfer Learning on Verb-Object Concept Images | |
Sun, Chao; Bao, Bing-Kun; Xu, Changsheng | |
发表期刊 | IEEE TRANSACTIONS ON MULTIMEDIA |
2015-10-01 | |
卷号 | 17期号:10页码:1747-1759 |
文章类型 | Article |
摘要 | Image retagging is significant and essential for tag-based applications, such as search and browsing. However, most existing image retagging approaches are typically based on enriching-and-removing and/or reranking strategies, which lead to two drawbacks: 1) since the object and/or human appeared in the images are tagged as individuals, the meanings represented by the mutual context of object and human are ignored and not tagged, and 2) some images which are visually dissimilar but semantically similar could be filtered incorrectly, as they are conflict with the content consistency rule. These two defects are distinct especially when images with human-object interactions are retagged. To tackle these defects, in this paper we propose a Bayesian approach to jointly consider the human and object in an image and retag it properly. In our approach, human and objects in images are detected and their interrelationships are taken into account. Tags which represent the mutual context of human and objects are then mapped to those interrelationships by a probabilistic graphical model. For a new image which lacks the tag representing the interaction between human and object, our model can correctly retag it for the interaction. In this paper, those images involving human-object interactions are called verb-object concept images, and experiments on a 60-class dataset demonstrate the capacity of our Bayesian retagging approach of verb-object concept images (BRVOI). |
关键词 | Bayesian Retagging Verb-object Image |
WOS标题词 | Science & Technology ; Technology |
DOI | 10.1109/TMM.2015.2463218 |
关键词[WOS] | CONTEXT ; MODELS |
收录类别 | SCI |
语种 | 英语 |
WOS研究方向 | Computer Science ; Telecommunications |
WOS类目 | Computer Science, Information Systems ; Computer Science, Software Engineering ; Telecommunications |
WOS记录号 | WOS:000361685400006 |
引用统计 | |
文献类型 | 期刊论文 |
条目标识符 | http://ir.ia.ac.cn/handle/173211/9019 |
专题 | 模式识别国家重点实验室_多媒体计算 |
作者单位 | Chinese Acad Sci, Inst Automat, Natl Lab Pattern Recognit, Beijing 100190, Peoples R China |
第一作者单位 | 模式识别国家重点实验室 |
推荐引用方式 GB/T 7714 | Sun, Chao,Bao, Bing-Kun,Xu, Changsheng. Knowing Verb From Object: Retagging With Transfer Learning on Verb-Object Concept Images[J]. IEEE TRANSACTIONS ON MULTIMEDIA,2015,17(10):1747-1759. |
APA | Sun, Chao,Bao, Bing-Kun,&Xu, Changsheng.(2015).Knowing Verb From Object: Retagging With Transfer Learning on Verb-Object Concept Images.IEEE TRANSACTIONS ON MULTIMEDIA,17(10),1747-1759. |
MLA | Sun, Chao,et al."Knowing Verb From Object: Retagging With Transfer Learning on Verb-Object Concept Images".IEEE TRANSACTIONS ON MULTIMEDIA 17.10(2015):1747-1759. |
条目包含的文件 | 下载所有文件 | |||||
文件名称/大小 | 文献类型 | 版本类型 | 开放类型 | 使用许可 | ||
Knowing Verb From Ob(1897KB) | 期刊论文 | 作者接受稿 | 开放获取 | CC BY-NC-SA | 浏览 下载 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论