CASIA OpenIR  > 类脑智能研究中心
Image Caption Generation with Part of Speech Guidance
Xinwei He; Baoguang Shi; Xiang Bai; Gui-Song Xia; Zhaoxiang Zhang; Weisheng Dong
2017
发表期刊Pattern Recognition Letters
期号1页码:1-9
摘要As a fundamental problem in image understanding, image caption generation has attracted much attention from both computer vision and natural language processing communities. In this paper, we focus on how to exploit the structure information of a natural sentence, which is used to describe the content of an image. We discover that the Part of Speech (PoS) tags of a sentence, are very effective cues for guiding the Long Short-Term Memory (LSTM) based word generator. More specifically, given a sentence, the PoS tag of each word is utilized to determine whether it is essential to input image representation into the word generator. Benefiting from such a strategy, our model can closely connect the visual attributes of an image to the word concepts in the natural language space. Experimental results on the most popular benchmark datasets, e.g., Flickr30k and MS COCO, consistently demonstrate that our method can significantly enhance the performance of a standard image caption generation model, and achieve the conpetitive results.
关键词Image Caption Generation Part-of-speech Tags Long Short-term Memory Visual Attributes
文献类型期刊论文
条目标识符http://ir.ia.ac.cn/handle/173211/21589
专题类脑智能研究中心
推荐引用方式
GB/T 7714
Xinwei He,Baoguang Shi,Xiang Bai,et al. Image Caption Generation with Part of Speech Guidance[J]. Pattern Recognition Letters,2017(1):1-9.
APA Xinwei He,Baoguang Shi,Xiang Bai,Gui-Song Xia,Zhaoxiang Zhang,&Weisheng Dong.(2017).Image Caption Generation with Part of Speech Guidance.Pattern Recognition Letters(1),1-9.
MLA Xinwei He,et al."Image Caption Generation with Part of Speech Guidance".Pattern Recognition Letters .1(2017):1-9.
条目包含的文件
条目无相关文件。
个性服务
推荐该条目
保存到收藏夹
查看访问统计
导出为Endnote文件
谷歌学术
谷歌学术中相似的文章
[Xinwei He]的文章
[Baoguang Shi]的文章
[Xiang Bai]的文章
百度学术
百度学术中相似的文章
[Xinwei He]的文章
[Baoguang Shi]的文章
[Xiang Bai]的文章
必应学术
必应学术中相似的文章
[Xinwei He]的文章
[Baoguang Shi]的文章
[Xiang Bai]的文章
相关权益政策
暂无数据
收藏/分享
所有评论 (0)
暂无评论
 

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。