Visuals to Text: A Comprehensive Review on Automatic Image Captioning

doi:10.1109/JAS.2022.105734

CASIA OpenIR > 学术期刊 > IEEE/CAA Journal of Automatica Sinica

	Visuals to Text: A Comprehensive Review on Automatic Image Captioning
	Yue Ming; Nannan Hu; Chunxiao Fan; Fan Feng; Jiangwan Zhou; Hui Yu
发表期刊	IEEE/CAA Journal of Automatica Sinica
ISSN	2329-9266
	2022
卷号	9 期号:8 页码:1339-1365
摘要	Image captioning refers to automatic generation of descriptive texts according to the visual content of images. It is a technique integrating multiple disciplines including the computer vision (CV), natural language processing (NLP) and artificial intelligence. In recent years, substantial research efforts have been devoted to generate image caption with impressive progress. To summarize the recent advances in image captioning, we present a comprehensive review on image captioning, covering both traditional methods and recent deep learning-based techniques. Specifically, we first briefly review the early traditional works based on the retrieval and template. Then deep learning-based image captioning researches are focused, which is categorized into the encoder-decoder framework, attention mechanism and training strategies on the basis of model structures and training manners for a detailed introduction. After that, we summarize the publicly available datasets, evaluation metrics and those proposed for specific requirements, and then compare the state of the art methods on the MS COCO dataset. Finally, we provide some discussions on open challenges and future research directions.
关键词	Artificial intelligence attention mechanism encoder-decoder framework image captioning multi-modal understanding training strategies
DOI	10.1109/JAS.2022.105734
引用统计	被引频次：6[WOS] [WOS记录] [WOS相关记录]
文献类型	期刊论文
条目标识符	http://ir.ia.ac.cn/handle/173211/49647
专题	学术期刊_IEEE/CAA Journal of Automatica Sinica
推荐引用方式 GB/T 7714	Yue Ming,Nannan Hu,Chunxiao Fan,et al. Visuals to Text: A Comprehensive Review on Automatic Image Captioning[J]. IEEE/CAA Journal of Automatica Sinica,2022,9(8):1339-1365.
APA	Yue Ming,Nannan Hu,Chunxiao Fan,Fan Feng,Jiangwan Zhou,&Hui Yu.(2022).Visuals to Text: A Comprehensive Review on Automatic Image Captioning.IEEE/CAA Journal of Automatica Sinica,9(8),1339-1365.
MLA	Yue Ming,et al."Visuals to Text: A Comprehensive Review on Automatic Image Captioning".IEEE/CAA Journal of Automatica Sinica 9.8(2022):1339-1365.

条目包含的文件		下载所有文件
文件名称/大小	文献类型	版本类型	开放类型	使用许可
JAS-2022-0235.pdf（56128KB）	期刊论文	出版稿	开放获取	CC BY-NC-SA	浏览下载