Learning Consistent Feature Representation for Cross-Modal Multimedia Retrieval
Kang, Cuicui; Xiang, Shiming; Liao, Shengcai; Xu, Changsheng; Pan, Chunhong
2015-03-01
发表期刊IEEE TRANSACTIONS ON MULTIMEDIA
卷号17期号:3页码:370-381
文章类型Article
摘要The cross-modal feature matching has gained much attention in recent years, which has many practical applications, such as the text-to-image retrieval. The most difficult problem of cross-modal matching is how to eliminate the heterogeneity between modalities. The existing methods (e.g., CCA and PLS) try to learn a common latent subspace, where the heterogeneity between two modalities is minimized so that cross-matching is possible. However, most of these methods require fully paired samples and suffer difficulties when dealing with unpaired data. Besides, utilizing the class label information has been found as a good way to reduce the semantic gap between the low-level image features and high-level document descriptions. Considering this, we propose a novel and effective supervised algorithm, which can also deal with the unpaired data. In the proposed formulation, the basis matrices of different modalities are jointly learned based on the training samples. Moreover, a local group-based priori is proposed in the formulation to make a better use of popular block based features (e.g., HOG and GIST). Extensive experiments are conducted on four public databases: Pascal VOC2007, LabelMe, Wikipedia, and NUS-WIDE. We also evaluated the proposed algorithm with unpaired data. By comparing with existing state-of-the-art algorithms, the results show that the proposed algorithm is more robust and achieves the best performance, which outperforms the second best algorithm by about 5% on both the Pascal VOC2007 and NUS-WIDE databases.
关键词Cross-modal Matching Documents And Images Multimedia Retrieval
WOS标题词Science & Technology ; Technology
关键词[WOS]FACE RECOGNITION ; LEAST-SQUARES ; REGRESSION ; SHRINKAGE ; SELECTION
收录类别SCI
语种英语
WOS研究方向Computer Science ; Telecommunications
WOS类目Computer Science, Information Systems ; Computer Science, Software Engineering ; Telecommunications
WOS记录号WOS:000351585700009
引用统计
被引频次:50[WOS]   [WOS记录]     [WOS相关记录]
文献类型期刊论文
条目标识符http://ir.ia.ac.cn/handle/173211/8094
专题模式识别国家重点实验室_先进数据分析与学习
作者单位Chinese Acad Sci, Inst Automat, Natl Lab Pattern Recognit, Beijing 100190, Peoples R China
推荐引用方式
GB/T 7714
Kang, Cuicui,Xiang, Shiming,Liao, Shengcai,et al. Learning Consistent Feature Representation for Cross-Modal Multimedia Retrieval[J]. IEEE TRANSACTIONS ON MULTIMEDIA,2015,17(3):370-381.
APA Kang, Cuicui,Xiang, Shiming,Liao, Shengcai,Xu, Changsheng,&Pan, Chunhong.(2015).Learning Consistent Feature Representation for Cross-Modal Multimedia Retrieval.IEEE TRANSACTIONS ON MULTIMEDIA,17(3),370-381.
MLA Kang, Cuicui,et al."Learning Consistent Feature Representation for Cross-Modal Multimedia Retrieval".IEEE TRANSACTIONS ON MULTIMEDIA 17.3(2015):370-381.
条目包含的文件 下载所有文件
文件名称/大小 文献类型 版本类型 开放类型 使用许可
2015_康翠翠_TMM.PDF(2326KB)期刊论文出版稿开放获取CC BY-NC-SA浏览 下载
个性服务
推荐该条目
保存到收藏夹
查看访问统计
导出为Endnote文件
谷歌学术
谷歌学术中相似的文章
[Kang, Cuicui]的文章
[Xiang, Shiming]的文章
[Liao, Shengcai]的文章
百度学术
百度学术中相似的文章
[Kang, Cuicui]的文章
[Xiang, Shiming]的文章
[Liao, Shengcai]的文章
必应学术
必应学术中相似的文章
[Kang, Cuicui]的文章
[Xiang, Shiming]的文章
[Liao, Shengcai]的文章
相关权益政策
暂无数据
收藏/分享
文件名: 2015_康翠翠_TMM.PDF
格式: Adobe PDF
所有评论 (0)
暂无评论
 

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。