CASIA OpenIR  > 学术期刊  > IEEE/CAA Journal of Automatica Sinica
Visuals to Text: A Comprehensive Review on Automatic Image Captioning
Yue Ming; Nannan Hu; Chunxiao Fan; Fan Feng; Jiangwan Zhou; Hui Yu
Source PublicationIEEE/CAA Journal of Automatica Sinica
ISSN2329-9266
2022
Volume9Issue:8Pages:1339-1365
AbstractImage captioning refers to automatic generation of descriptive texts according to the visual content of images. It is a technique integrating multiple disciplines including the computer vision (CV), natural language processing (NLP) and artificial intelligence. In recent years, substantial research efforts have been devoted to generate image caption with impressive progress. To summarize the recent advances in image captioning, we present a comprehensive review on image captioning, covering both traditional methods and recent deep learning-based techniques. Specifically, we first briefly review the early traditional works based on the retrieval and template. Then deep learning-based image captioning researches are focused, which is categorized into the encoder-decoder framework, attention mechanism and training strategies on the basis of model structures and training manners for a detailed introduction. After that, we summarize the publicly available datasets, evaluation metrics and those proposed for specific requirements, and then compare the state of the art methods on the MS COCO dataset. Finally, we provide some discussions on open challenges and future research directions.
KeywordArtificial intelligence attention mechanism encoder-decoder framework image captioning multi-modal understanding training strategies
DOI10.1109/JAS.2022.105734
Citation statistics
Document Type期刊论文
Identifierhttp://ir.ia.ac.cn/handle/173211/49647
Collection学术期刊_IEEE/CAA Journal of Automatica Sinica
Recommended Citation
GB/T 7714
Yue Ming,Nannan Hu,Chunxiao Fan,et al. Visuals to Text: A Comprehensive Review on Automatic Image Captioning[J]. IEEE/CAA Journal of Automatica Sinica,2022,9(8):1339-1365.
APA Yue Ming,Nannan Hu,Chunxiao Fan,Fan Feng,Jiangwan Zhou,&Hui Yu.(2022).Visuals to Text: A Comprehensive Review on Automatic Image Captioning.IEEE/CAA Journal of Automatica Sinica,9(8),1339-1365.
MLA Yue Ming,et al."Visuals to Text: A Comprehensive Review on Automatic Image Captioning".IEEE/CAA Journal of Automatica Sinica 9.8(2022):1339-1365.
Files in This Item: Download All
File Name/Size DocType Version Access License
JAS-2022-0235.pdf(56128KB)期刊论文出版稿开放获取CC BY-NC-SAView Download
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Yue Ming]'s Articles
[Nannan Hu]'s Articles
[Chunxiao Fan]'s Articles
Baidu academic
Similar articles in Baidu academic
[Yue Ming]'s Articles
[Nannan Hu]'s Articles
[Chunxiao Fan]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Yue Ming]'s Articles
[Nannan Hu]'s Articles
[Chunxiao Fan]'s Articles
Terms of Use
No data!
Social Bookmark/Share
File name: JAS-2022-0235.pdf
Format: Adobe PDF
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.