A lighting robust fitting approach of 3D morphable model for face reconstruction | |
Ma, Mingyang; Peng, Silong; Hu, Xiyuan | |
发表期刊 | The Visual Computer |
2015-09-21 | |
卷号 | 32期号:10页码:1223-1238 |
摘要 | Three-dimensional morphable model (3DMM) is a powerful tool for recovering 3D shape and texture from a single facial image. The success of 3DMM relies on two things: an effective optimization strategy and a realistic approach to synthesizing face images. However, most previous methods have focused on developing an optimization strategy under Phong’s synthesis approach. In this paper, we adopt a more realistic synthesis technique that fully considers illumination and reflectance in the 3DMMfitting process. Using the sphere harmonic illumination model (SHIM), our newsynthesis approach can account for more lighting factors than Phong’s model. Spatially varying specular reflectance is also introduced into the synthesis process. Under SHIM, the cost function is nearly linear for all parameters, which simplifies the optimization. We apply our new optimization algorithm to determine the shape and texture parameters simultaneously. The accuracy of the recovered shape and texture can be improved significantly by considering the spatially varying specular reflectance. Hence, our algorithm produces an enhanced shape and texture compared with previous SHIM-based methods that recover shape from feature points. Although we use just a single input image in a profile pose, our approach gives plausible results. Experiments on a well-known image database show that, compared to state-of-the-art methods based on Phong’s model, the proposed approach enhances the robustness of the 3DMM fitting results under extreme lighting and profile pose. |
关键词 | Morphable Model 3d Face Sphere Harmonic Illumination Spatial Varying Specular Reflectance |
DOI | 10.1007/s00371-015-1158-z |
引用统计 | |
文献类型 | 期刊论文 |
条目标识符 | http://ir.ia.ac.cn/handle/173211/19682 |
专题 | 智能制造技术与系统研究中心_多维数据分析(彭思龙)-技术团队 |
通讯作者 | Hu, Xiyuan |
作者单位 | Insititute of Automation, Chinese Academy of Sciences |
推荐引用方式 GB/T 7714 | Ma, Mingyang,Peng, Silong,Hu, Xiyuan. A lighting robust fitting approach of 3D morphable model for face reconstruction[J]. The Visual Computer,2015,32(10):1223-1238. |
APA | Ma, Mingyang,Peng, Silong,&Hu, Xiyuan.(2015).A lighting robust fitting approach of 3D morphable model for face reconstruction.The Visual Computer,32(10),1223-1238. |
MLA | Ma, Mingyang,et al."A lighting robust fitting approach of 3D morphable model for face reconstruction".The Visual Computer 32.10(2015):1223-1238. |
条目包含的文件 | 下载所有文件 | |||||
文件名称/大小 | 文献类型 | 版本类型 | 开放类型 | 使用许可 | ||
A lighting robust fi(3548KB) | 期刊论文 | 作者接受稿 | 开放获取 | CC BY-NC-SA | 浏览 下载 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论