Name-face association with web facial image supervision
Chen, Zhineng1; Zhang, Wei2; Deng, Bin3; Xie, Hongtao2; Gu, Xiaoyan2
发表期刊MULTIMEDIA SYSTEMS
ISSN0942-4962
2019-02-01
卷号25期号:1页码:1-20
摘要

This paper describes methods for automatically associating faces detected from multimedia documents with their names presented in the surrounding metadata. We consider the task in the image matching (IM) framework, where external Web facial images are automatically retrieved as the gallery face set of the names in advance, and a detected face is assigned to one of the names, or none of them, according to the association score between the two kinds of faces and constraints. Several important issues are investigated within the IM framework. In collecting Web facial images, beyond the basic scheme that use a celebrity name purely as the query to crawl facial images, a context-assisted image search method is proposed to enhance the relevance and discriminability of the retrieved faces. In constraint formulation, we propose an assigning-thresholding (AT) pipeline to uniformly ensure that the name-face correspondence is strictly one-to-one, and set low confidence associations as null assignments. In association score computation, we propose methods that jointly consider IM with the well-established graph-based association (GA) method at different stages, aiming at producing more accurate scores to benefit the association. Based on these efforts, an Accu-IM method performing the association as accurate as possible and a Fast-IM method performing the association in real-time are respective proposed. Extensive experiments on datasets of captioned News images and Web videos both demonstrate the advantages of the proposed efforts individually and jointly, which consistently provide improvement gains under different settings when compared with state-of-the-art methods.

关键词Name-face association Image matching Multimedia fusion Web facial images Weakly supervised
DOI10.1007/s00530-017-0544-y
关键词[WOS]RECOGNITION ; ANNOTATION ; IDENTIFICATION ; VERIFICATION ; DISCOVERY ; SCHEME ; VIDEOS ; MOVIE
收录类别SCI
语种英语
资助项目National Nature Science Foundation of China[61602463] ; National Nature Science Foundation of China[61303171] ; National Nature Science Foundation of China[61303175] ; National Nature Science Foundation of China[61303175] ; National Nature Science Foundation of China[61303171] ; National Nature Science Foundation of China[61602463]
WOS研究方向Computer Science
WOS类目Computer Science, Information Systems ; Computer Science, Theory & Methods
WOS记录号WOS:000459419800001
出版者SPRINGER
七大方向——子方向分类图像视频处理与分析
引用统计
被引频次:5[WOS]   [WOS记录]     [WOS相关记录]
文献类型期刊论文
条目标识符http://ir.ia.ac.cn/handle/173211/25009
专题数字内容技术与服务研究中心_远程智能医疗
通讯作者Xie, Hongtao
作者单位1.Chinese Acad Sci, Inst Automat, Beijing 100190, Peoples R China
2.Chinese Acad Sci, Inst Informat Engn, Beijing 100093, Peoples R China
3.Hunan Univ Technol, Sch Comp Sci, Zhuzhou 412007, Hunan, Peoples R China
第一作者单位中国科学院自动化研究所
推荐引用方式
GB/T 7714
Chen, Zhineng,Zhang, Wei,Deng, Bin,et al. Name-face association with web facial image supervision[J]. MULTIMEDIA SYSTEMS,2019,25(1):1-20.
APA Chen, Zhineng,Zhang, Wei,Deng, Bin,Xie, Hongtao,&Gu, Xiaoyan.(2019).Name-face association with web facial image supervision.MULTIMEDIA SYSTEMS,25(1),1-20.
MLA Chen, Zhineng,et al."Name-face association with web facial image supervision".MULTIMEDIA SYSTEMS 25.1(2019):1-20.
条目包含的文件 下载所有文件
文件名称/大小 文献类型 版本类型 开放类型 使用许可
[MMSJ'19]Name-face a(3705KB)期刊论文作者接受稿开放获取CC BY-NC-SA浏览 下载
个性服务
推荐该条目
保存到收藏夹
查看访问统计
导出为Endnote文件
谷歌学术
谷歌学术中相似的文章
[Chen, Zhineng]的文章
[Zhang, Wei]的文章
[Deng, Bin]的文章
百度学术
百度学术中相似的文章
[Chen, Zhineng]的文章
[Zhang, Wei]的文章
[Deng, Bin]的文章
必应学术
必应学术中相似的文章
[Chen, Zhineng]的文章
[Zhang, Wei]的文章
[Deng, Bin]的文章
相关权益政策
暂无数据
收藏/分享
文件名: [MMSJ'19]Name-face association with web facial image supervision.pdf
格式: Adobe PDF
此文件暂不支持浏览
所有评论 (0)
暂无评论
 

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。