Knowledge Commons of Institute of Automation，CAS
| Towards Robust and Accurate Multi-View and Partially-Occluded Face Alignment | |
Xing, Junliang1 ; Niu, Zhiheng2; Huang, Junshi3; Hu, Weiming4; Zhou, Xi5; Yan, Shuicheng3,6
| |
| 发表期刊 | IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE
 |
| 2018-04-01 | |
| 卷号 | 40期号:4页码:987-1001 |
| 文章类型 | Article |
| 摘要 | Face alignment acts as an important task in computer vision. Regression-based methods currently dominate the approach to solving this problem, which generally employ a series of mapping functions from the face appearance to iteratively update the face shape hypothesis. One keypoint here is thus how to perform the regression procedure. In this work, we formulate this regression procedure as a sparse coding problem. We learn two relational dictionaries, one for the face appearance and the other one for the face shape, with coupled reconstruction coefficient to capture their underlying relationships. To deploy this model for face alignment, we derive the relational dictionaries in a stage-wised manner to perform close-loop refinement of themselves,i.e., the face appearance dictionary is first learned from the face shape dictionary and then used to update the face shape hypothesis, and the updated face shape dictionary from the shape hypothesis is in return used to refine the face appearance dictionary. To improve the model accuracy, we extend this model hierarchically from the whole face shape to face part shapes, thus both the global and local view variations of a face are captured. To locate facial landmarks under occlusions, we further introduce an occlusion dictionary into the face appearance dictionary to recover face shape from partially occluded face appearance. The occlusion dictionary is learned in a data driven manner from background images to represent a set of elemental occlusion patterns, a sparse combination of which models various practical partial face occlusions. By integrating all these technical innovations, we obtain a robust and accurate approach to locate facial landmarks under different face views and possibly severe occlusions for face images in the wild. Extensive experimental analyses and evaluations on different benchmark datasets, as well as two new datasets built by ourselves, have demonstrated the robustness and accuracy of our proposed model, especially for face images with large view variations and/or severe occlusions. |
| 关键词 | Face Alignment Dictionary Learning Sparse Representation Appearance-shape Modeling |
| WOS标题词 | Science & Technology ; Technology |
| DOI | 10.1109/TPAMI.2017.2697958 |
| 关键词[WOS] | ACTIVE APPEARANCE MODELS ; SPARSE REPRESENTATION ; FEATURE LOCALIZATION ; RECOGNITION ; FEATURES ; REGRESSION |
| 收录类别 | SCI |
| 语种 | 英语 |
| 项目资助者 | 973 basic research program of China(2014CB349303) ; Natural Science Foundation of China(61672519 ; Strategic Priority Research Program of the CAS(XDB02070003) ; 61303178 ; 61472421 ; U1636218) |
| WOS研究方向 | Computer Science ; Engineering |
| WOS类目 | Computer Science, Artificial Intelligence ; Engineering, Electrical & Electronic |
| WOS记录号 | WOS:000426687100016 |
| 引用统计 | |
| 文献类型 | 期刊论文 |
| 条目标识符 | http://ir.ia.ac.cn/handle/173211/19746 |
| 专题 | 多模态人工智能系统全国重点实验室_视频内容安全 |
| 作者单位 | 1.Chinese Acad Sci, Inst Automat, Natl Lab Pattern Recognit, Beijing 100190, Peoples R China 2.Delphi Deutschland GMBH, Adv Engn Elect & Safety, Delphipl 1, D-42119 Wuppertal, North Rhine Wes, Germany 3.AI Inst Qihoo 360 Co, Jiuxianqiao Rd, Beijing 100015, Peoples R China 4.Univ Chinese Acad Sci, Chinese Acad Sci, Inst Automat,Natl Lab Pattern Recognit, CAS Ctr Excellence Brain Sci & Intelligence Techn, Beijing 100190, Peoples R China 5.Chinese Acad Sci, Chongqing Inst Green & Intelligent Technol, Intelligent Media Tech Res Ctr, Chongqing 400714, Peoples R China 6.Natl Univ Singapore, Dept Elect & Comp Engn, Singapore 117576, Singapore |
| 第一作者单位 | 模式识别国家重点实验室 |
| 推荐引用方式 GB/T 7714 | Xing, Junliang,Niu, Zhiheng,Huang, Junshi,et al. Towards Robust and Accurate Multi-View and Partially-Occluded Face Alignment[J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE,2018,40(4):987-1001. |
| APA | Xing, Junliang,Niu, Zhiheng,Huang, Junshi,Hu, Weiming,Zhou, Xi,&Yan, Shuicheng.(2018).Towards Robust and Accurate Multi-View and Partially-Occluded Face Alignment.IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE,40(4),987-1001. |
| MLA | Xing, Junliang,et al."Towards Robust and Accurate Multi-View and Partially-Occluded Face Alignment".IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE 40.4(2018):987-1001. |
| 条目包含的文件 | 下载所有文件 | |||||
| 文件名称/大小 | 文献类型 | 版本类型 | 开放类型 | 使用许可 | ||
| TPAMI17HSRD.pdf（8206KB） | 期刊论文 | 作者接受稿 | 开放获取 | CC BY-NC-SA | 浏览 下载 | |
除非特别说明，本系统中所有内容都受版权保护，并保留所有权利。
修改评论