Learning Scene Illumination by Pairwise Photos from Rear and Front Mobile Cameras

doi:10.1111/cgf.13561

CASIA OpenIR > 多模态人工智能系统全国重点实验室 > 三维可视计算

	Learning Scene Illumination by Pairwise Photos from Rear and Front Mobile Cameras
	Cheng, Dachuan 1; Shi, Jian2 ; Chen, Yanyun 1; Deng, Xiaoming 3; Zhang, Xiaopeng2
发表期刊	COMPUTER GRAPHICS FORUM
ISSN	0167-7055
	2018-10-01
卷号	37 期号:7 页码:213-221
通讯作者	Cheng, Dachuan()
摘要	Illumination estimation is an essential problem in computer vision, graphics and augmented reality. In this paper, we propose a learning based method to recover low-frequency scene illumination represented as spherical harmonic (SH) functions by pairwise photos from rear and front cameras on mobile devices. An end-to-end deep convolutional neural network (CNN) structure is designed to process images on symmetric views and predict SH coefficients. We introduce a novel Render Loss to improve the rendering quality of the predicted illumination. A high quality high dynamic range (HDR) panoramic image dataset was developed for training and evaluation. Experiments show that our model produces visually and quantitatively superior results compared to the state-of-the-arts. Moreover, our method is practical for mobile-based applications.
DOI	10.1111/cgf.13561
关键词[WOS]	REFLECTANCE
收录类别	SCI
语种	英语
资助项目	National Natural Science Foundation of China[61473276] ; National Natural Science Foundation of China[61331018] ; National Natural Science Foundation of China[61620106003] ; National Natural Science Foundation of China[61620106003] ; National Natural Science Foundation of China[61331018] ; National Natural Science Foundation of China[61473276]
项目资助者	National Natural Science Foundation of China
WOS研究方向	Computer Science
WOS类目	Computer Science, Software Engineering
WOS记录号	WOS:000448166700020
出版者	WILEY
引用统计	被引频次：30[WOS] [WOS记录] [WOS相关记录]
文献类型	期刊论文
条目标识符	http://ir.ia.ac.cn/handle/173211/22795
专题	多模态人工智能系统全国重点实验室_三维可视计算
通讯作者	Cheng, Dachuan
作者单位	1.Univ Chinese Acad Sci, Inst Software, State Key Lab Comp Sci, Beijing, Peoples R China 2.Univ Chinese Acad Sci, Inst Automat, Beijing, Peoples R China 3.Chinese Acad Sci, Inst Software, Beijing Key Lab Human Comp Interact, Beijing, Peoples R China
推荐引用方式 GB/T 7714	Cheng, Dachuan,Shi, Jian,Chen, Yanyun,et al. Learning Scene Illumination by Pairwise Photos from Rear and Front Mobile Cameras[J]. COMPUTER GRAPHICS FORUM,2018,37(7):213-221.
APA	Cheng, Dachuan,Shi, Jian,Chen, Yanyun,Deng, Xiaoming,&Zhang, Xiaopeng.(2018).Learning Scene Illumination by Pairwise Photos from Rear and Front Mobile Cameras.COMPUTER GRAPHICS FORUM,37(7),213-221.
MLA	Cheng, Dachuan,et al."Learning Scene Illumination by Pairwise Photos from Rear and Front Mobile Cameras".COMPUTER GRAPHICS FORUM 37.7(2018):213-221.

条目包含的文件		下载所有文件
文件名称/大小	文献类型	版本类型	开放类型	使用许可
pg2018.pdf（5737KB）	期刊论文	作者接受稿	开放获取	CC BY-NC-SA	浏览下载