CASIA OpenIR  > 智能制造技术与系统研究中心  > 多维数据分析
A lighting robust fitting approach of 3D morphable model for face reconstruction
Ma, Mingyang; Peng, Silong; Hu, Xiyuan
Source PublicationThe Visual Computer
2015-09-21
Volume32Issue:10Pages:1223-1238
AbstractThree-dimensional morphable model (3DMM) is a powerful tool for recovering 3D shape and texture from a single facial image. The success of 3DMM relies on two things: an effective optimization strategy and a realistic approach to synthesizing face images. However, most previous methods have focused on developing an optimization strategy under Phong’s synthesis approach. In this paper, we adopt a more realistic synthesis technique that fully considers illumination and reflectance in the 3DMMfitting process. Using the sphere harmonic illumination model (SHIM), our
newsynthesis approach can account for more lighting factors than Phong’s model. Spatially varying specular reflectance is also introduced into the synthesis process. Under SHIM, the cost function is nearly linear for all parameters, which simplifies the optimization. We apply our new optimization algorithm to determine the shape and texture parameters simultaneously. The accuracy of the recovered shape and texture can be improved significantly by considering the spatially varying specular reflectance. Hence, our algorithm produces an enhanced shape and texture compared with previous SHIM-based methods that recover shape from feature points. Although we use just a single input image in a profile pose, our approach gives plausible results. Experiments on a well-known image database show that, compared to state-of-the-art methods based on Phong’s model, the proposed approach enhances the robustness of the 3DMM fitting results under extreme lighting and profile pose.
KeywordMorphable Model 3d Face Sphere Harmonic Illumination Spatial Varying Specular Reflectance
DOI10.1007/s00371-015-1158-z
Citation statistics
Document Type期刊论文
Identifierhttp://ir.ia.ac.cn/handle/173211/19682
Collection智能制造技术与系统研究中心_多维数据分析
Corresponding AuthorHu, Xiyuan
AffiliationInsititute of Automation, Chinese Academy of Sciences
Recommended Citation
GB/T 7714
Ma, Mingyang,Peng, Silong,Hu, Xiyuan. A lighting robust fitting approach of 3D morphable model for face reconstruction[J]. The Visual Computer,2015,32(10):1223-1238.
APA Ma, Mingyang,Peng, Silong,&Hu, Xiyuan.(2015).A lighting robust fitting approach of 3D morphable model for face reconstruction.The Visual Computer,32(10),1223-1238.
MLA Ma, Mingyang,et al."A lighting robust fitting approach of 3D morphable model for face reconstruction".The Visual Computer 32.10(2015):1223-1238.
Files in This Item: Download All
File Name/Size DocType Version Access License
A lighting robust fi(3548KB)期刊论文作者接受稿开放获取CC BY-NC-SAView Download
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Ma, Mingyang]'s Articles
[Peng, Silong]'s Articles
[Hu, Xiyuan]'s Articles
Baidu academic
Similar articles in Baidu academic
[Ma, Mingyang]'s Articles
[Peng, Silong]'s Articles
[Hu, Xiyuan]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Ma, Mingyang]'s Articles
[Peng, Silong]'s Articles
[Hu, Xiyuan]'s Articles
Terms of Use
No data!
Social Bookmark/Share
File name: A lighting robust fitting approach of 3D morphable model for face.pdf
Format: Adobe PDF
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.