Name-face association with web facial image supervision | |
Chen, Zhineng1; Zhang, Wei2; Deng, Bin3; Xie, Hongtao2; Gu, Xiaoyan2 | |
发表期刊 | MULTIMEDIA SYSTEMS |
ISSN | 0942-4962 |
2019-02-01 | |
卷号 | 25期号:1页码:1-20 |
摘要 | This paper describes methods for automatically associating faces detected from multimedia documents with their names presented in the surrounding metadata. We consider the task in the image matching (IM) framework, where external Web facial images are automatically retrieved as the gallery face set of the names in advance, and a detected face is assigned to one of the names, or none of them, according to the association score between the two kinds of faces and constraints. Several important issues are investigated within the IM framework. In collecting Web facial images, beyond the basic scheme that use a celebrity name purely as the query to crawl facial images, a context-assisted image search method is proposed to enhance the relevance and discriminability of the retrieved faces. In constraint formulation, we propose an assigning-thresholding (AT) pipeline to uniformly ensure that the name-face correspondence is strictly one-to-one, and set low confidence associations as null assignments. In association score computation, we propose methods that jointly consider IM with the well-established graph-based association (GA) method at different stages, aiming at producing more accurate scores to benefit the association. Based on these efforts, an Accu-IM method performing the association as accurate as possible and a Fast-IM method performing the association in real-time are respective proposed. Extensive experiments on datasets of captioned News images and Web videos both demonstrate the advantages of the proposed efforts individually and jointly, which consistently provide improvement gains under different settings when compared with state-of-the-art methods. |
关键词 | Name-face association Image matching Multimedia fusion Web facial images Weakly supervised |
DOI | 10.1007/s00530-017-0544-y |
关键词[WOS] | RECOGNITION ; ANNOTATION ; IDENTIFICATION ; VERIFICATION ; DISCOVERY ; SCHEME ; VIDEOS ; MOVIE |
收录类别 | SCI |
语种 | 英语 |
资助项目 | National Nature Science Foundation of China[61602463] ; National Nature Science Foundation of China[61303171] ; National Nature Science Foundation of China[61303175] ; National Nature Science Foundation of China[61303175] ; National Nature Science Foundation of China[61303171] ; National Nature Science Foundation of China[61602463] |
WOS研究方向 | Computer Science |
WOS类目 | Computer Science, Information Systems ; Computer Science, Theory & Methods |
WOS记录号 | WOS:000459419800001 |
出版者 | SPRINGER |
七大方向——子方向分类 | 图像视频处理与分析 |
引用统计 | |
文献类型 | 期刊论文 |
条目标识符 | http://ir.ia.ac.cn/handle/173211/25009 |
专题 | 数字内容技术与服务研究中心_远程智能医疗 |
通讯作者 | Xie, Hongtao |
作者单位 | 1.Chinese Acad Sci, Inst Automat, Beijing 100190, Peoples R China 2.Chinese Acad Sci, Inst Informat Engn, Beijing 100093, Peoples R China 3.Hunan Univ Technol, Sch Comp Sci, Zhuzhou 412007, Hunan, Peoples R China |
第一作者单位 | 中国科学院自动化研究所 |
推荐引用方式 GB/T 7714 | Chen, Zhineng,Zhang, Wei,Deng, Bin,et al. Name-face association with web facial image supervision[J]. MULTIMEDIA SYSTEMS,2019,25(1):1-20. |
APA | Chen, Zhineng,Zhang, Wei,Deng, Bin,Xie, Hongtao,&Gu, Xiaoyan.(2019).Name-face association with web facial image supervision.MULTIMEDIA SYSTEMS,25(1),1-20. |
MLA | Chen, Zhineng,et al."Name-face association with web facial image supervision".MULTIMEDIA SYSTEMS 25.1(2019):1-20. |
条目包含的文件 | 下载所有文件 | |||||
文件名称/大小 | 文献类型 | 版本类型 | 开放类型 | 使用许可 | ||
[MMSJ'19]Name-face a(3705KB) | 期刊论文 | 作者接受稿 | 开放获取 | CC BY-NC-SA | 浏览 下载 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论