CASIA OpenIR  > 智能感知与计算
ACMM: Aligned Cross-Modal Memory for Few-Shot Image and Sentence Matching
Huang, Yan; Wang, Liang
Conference NameIEEE International Conference on Computer Vision (ICCV)
Conference Date2019.10.26-2019.11.2
Conference PlaceSeoul
Author of SourceKyoung Mu Lee
Publication PlaceUSA

Image and sentence matching has drawn much attention
recently, but due to the lack of sufficient pairwise data for
training, most previous methods still cannot well associate
those challenging pairs of images and sentences containing
rarely appeared regions and words, i.e., few-shot content.
In this work, we study this challenging scenario as few-shot
image and sentence matching, and accordingly propose an
Aligned Cross-Modal Memory (ACMM) model to memorize
the rarely appeared content. Given a pair of image and sentence,
the model first includes an aligned memory controller
network to produce two sets of semantically-comparable interface
vectors through cross-modal alignment. Then the
interface vectors are used by modality-specific read and update
operations to alternatively interact with shared memory
items. The memory items persistently memorize crossmodal
shared semantic representations, which can be addressed
out to better enhance the representation of few-shot
content. We apply the proposed model to both conventional
and few-shot image and sentence matching tasks, and
demonstrate its effectiveness by achieving the state-of-theart
performance on two benchmark datasets.

KeywordImage And Sentence Matching
MOST Discipline Catalogue工学
Indexed ByEI
Citation statistics
Document Type会议论文
Recommended Citation
GB/T 7714
Huang, Yan,Wang, Liang. ACMM: Aligned Cross-Modal Memory for Few-Shot Image and Sentence Matching[C]//Kyoung Mu Lee. USA:IEEE,2019:0.
Files in This Item:
There are no files associated with this item.
Related Services
Recommend this item
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Huang, Yan]'s Articles
[Wang, Liang]'s Articles
Baidu academic
Similar articles in Baidu academic
[Huang, Yan]'s Articles
[Wang, Liang]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Huang, Yan]'s Articles
[Wang, Liang]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.