CASIA OpenIR  > 智能感知与计算研究中心
ACMM: Aligned Cross-Modal Memory for Few-Shot Image and Sentence Matching
Huang, Yan; Wang, Liang
2019-11
Conference NameIEEE International Conference on Computer Vision (ICCV)
Volume0
Issue0
Pages0
Conference Date2019.10.26-2019.11.2
Conference PlaceSeoul
Author of SourceKyoung Mu Lee
Publication PlaceUSA
PublisherIEEE
Abstract

Image and sentence matching has drawn much attention
recently, but due to the lack of sufficient pairwise data for
training, most previous methods still cannot well associate
those challenging pairs of images and sentences containing
rarely appeared regions and words, i.e., few-shot content.
In this work, we study this challenging scenario as few-shot
image and sentence matching, and accordingly propose an
Aligned Cross-Modal Memory (ACMM) model to memorize
the rarely appeared content. Given a pair of image and sentence,
the model first includes an aligned memory controller
network to produce two sets of semantically-comparable interface
vectors through cross-modal alignment. Then the
interface vectors are used by modality-specific read and update
operations to alternatively interact with shared memory
items. The memory items persistently memorize crossmodal
shared semantic representations, which can be addressed
out to better enhance the representation of few-shot
content. We apply the proposed model to both conventional
and few-shot image and sentence matching tasks, and
demonstrate its effectiveness by achieving the state-of-theart
performance on two benchmark datasets.

KeywordImage And Sentence Matching
MOST Discipline Catalogue工学
DOI0
URL查看原文
Indexed ByEI
Citation statistics
Document Type会议论文
Identifierhttp://ir.ia.ac.cn/handle/173211/25797
Collection智能感知与计算研究中心
Affiliation中科院自动化所
Recommended Citation
GB/T 7714
Huang, Yan,Wang, Liang. ACMM: Aligned Cross-Modal Memory for Few-Shot Image and Sentence Matching[C]//Kyoung Mu Lee. USA:IEEE,2019:0.
Files in This Item:
There are no files associated with this item.
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Huang, Yan]'s Articles
[Wang, Liang]'s Articles
Baidu academic
Similar articles in Baidu academic
[Huang, Yan]'s Articles
[Wang, Liang]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Huang, Yan]'s Articles
[Wang, Liang]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.