Distinguishing Between Natural and Computer-Generated Images Using Convolutional Neural Networks
Weize Quan; Kai Wang; Dong-Ming Yan; Xiaopeng Zhang
2018-05-07
发表期刊IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY
卷号13期号:11页码:2772 - 2787
摘要Distinguishing between natural images (NIs) and computer-generated (CG) images by naked human eyes is difficult. In this paper, we propose an effective method based on a convolutional neural network (CNN) for this fundamental image forensic problem. Having observed the rather limited performance of training existing CCNs from scratch or fine-tuning pre-trained network, we design and implement a new and appropriate network with two cascaded convolutional layers at the bottom of a CNN. Our network can be easily adjusted to accommodate different sizes of input image patches while maintaining a fixed depth, a stable structure of CNN, and a good forensic performance. Considering the complexity of training CNNs and the specific requirement of image forensics, we introduce the so-called local-to-global strategy in our proposed network. Our CNN derives a forensic decision on local patches, and a global decision on a full-sized image can be easily obtained via simple majority voting. This strategy can also be used to improve the performance of existing methods that are based on hand-crafted features. Experimental results show that our method outperforms existing methods, especially in a challenging forensic scenario with NIs and CG images of heterogeneous origins. Our method also has good robustness against typical post-processing operations, such as resizing and JPEG compression. Unlike previous attempts to use CNNs for image forensics, we try to understand what our CNN has learned about the differences between NIs and CG images with the aid of adequate and advanced visualization tools.; Distinguishing between natural images (NIs) and computer-generated (CG) images by naked human eyes is difficult. In this paper, we propose an effective method based on a convolutional neural network (CNN) for this fundamental image forensic problem. Having observed the rather limited performance of training existing CCNs from scratch or fine-tuning pre-trained network, we design and implement a new and appropriate network with two cascaded convolutional layers at the bottom of a CNN. Our network can be easily adjusted to accommodate different sizes of input image patches while maintaining a fixed depth, a stable structure of CNN, and a good forensic performance. Considering the complexity of training CNNs and the specific requirement of image forensics, we introduce the so-called local-to-global strategy in our proposed network. Our CNN derives a forensic decision on local patches, and a global decision on a full-sized image can be easily obtained via simple majority voting. This strategy can also be used to improve the performance of existing methods that are based on hand-crafted features. Experimental results show that our method outperforms existing methods, especially in a challenging forensic scenario with NIs and CG images of heterogeneous origins. Our method also has good robustness against typical post-processing operations, such as resizing and JPEG compression. Unlike previous attempts to use CNNs for image forensics, we try to understand what our CNN has learned about the differences between NIs and CG images with the aid of adequate and advanced visualization tools.
关键词Image Forensics Natural Image Computergenerated Image Convolutional Neural Network Robustness Localto- Global Strategy Visualization
DOI10.1109/TIFS.2018.2834147
引用统计
被引频次:2[WOS]   [WOS记录]     [WOS相关记录]
文献类型期刊论文
条目标识符http://ir.ia.ac.cn/handle/173211/21683
专题模式识别国家重点实验室_多媒体计算与图形学
通讯作者Dong-Ming Yan
作者单位1.National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences
2.the University of Chinese Academy of Sciences
3.University Grenoble Alpes, CNRS, Grenoble INP, GIPSA-lab
推荐引用方式
GB/T 7714
Weize Quan,Kai Wang,Dong-Ming Yan,et al. Distinguishing Between Natural and Computer-Generated Images Using Convolutional Neural Networks[J]. IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY,2018,13(11):2772 - 2787.
APA Weize Quan,Kai Wang,Dong-Ming Yan,&Xiaopeng Zhang.(2018).Distinguishing Between Natural and Computer-Generated Images Using Convolutional Neural Networks.IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY,13(11),2772 - 2787.
MLA Weize Quan,et al."Distinguishing Between Natural and Computer-Generated Images Using Convolutional Neural Networks".IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY 13.11(2018):2772 - 2787.
条目包含的文件 下载所有文件
文件名称/大小 文献类型 版本类型 开放类型 使用许可
2018_TIFS_iunacg.pdf(8950KB)期刊论文作者接受稿开放获取CC BY-NC-SA浏览 下载
个性服务
推荐该条目
保存到收藏夹
查看访问统计
导出为Endnote文件
谷歌学术
谷歌学术中相似的文章
[Weize Quan]的文章
[Kai Wang]的文章
[Dong-Ming Yan]的文章
百度学术
百度学术中相似的文章
[Weize Quan]的文章
[Kai Wang]的文章
[Dong-Ming Yan]的文章
必应学术
必应学术中相似的文章
[Weize Quan]的文章
[Kai Wang]的文章
[Dong-Ming Yan]的文章
相关权益政策
暂无数据
收藏/分享
文件名: 2018_TIFS_iunacg.pdf
格式: Adobe PDF
所有评论 (0)
暂无评论
 

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。