CASIA OpenIR  > 智能感知与计算研究中心
Multi angle optimal pattern-based deep learning for automatic facial expression recognition
Jain Deepak Kumar1,2; Zhang Zhang1,2; Huang Kaiqi1,2; Kaiqi Huang
2017
发表期刊Pattern Recognition Letters
期号XX页码:1-9
摘要
Facial Expression Recognition (FER) plays the vital role in the Human Computer Interface (HCI) applications. The illumination and pose variations affect the FER adversely. The projection of complex 3D actions on the image plane and the inaccurate alignment are the major issues in the FER process. This paper presents the novel Multi-Angle Optimal Pattern-based Deep Learning (MAOP-DL) method to rectify the problem from sudden illumination changes, find the proper alignment of a feature set by using multi-angle-based optimal configurations. The proposed method includes the five major processes as Extended Boundary Background Subtraction (EBBS), Multi-Angle Texture Pattern+STM, Densely Extracted SURF+Local Occupancy Pattern (LOP), Priority Particle Cuckoo Search Optimization (PPCSO) and Long Short-Term Memory -Convolutional Neural Network (LSTM-CNN). Initially, the EBBS algorithm subtracts the background and isolates the foreground from the images which overcome the illumination and pose variation. Then, the MATP-STM extracts the texture patterns and DESURF-LOP extracts the relevant key features of the facial points. The PPCSO algorithm selects the relevant features from the MATP-STM feature set to speed up the classification. The employment of LSTM-CNN predicts the required label for the facial expressions.The major key findings of the proposed work are clear image analysis, effective handling of pose/illumination variations and the facial alignment. The proposed MAOP-DL validates its effectiveness on two standard databases such as CK+ and MMI regarding various metrics and confirm their assurance of wide applicability in recent applications.
;
Facial Expression Recognition (FER) plays the vital role in the Human Computer Interface (HCI) applications. The illumination and pose variations affect the FER adversely. The projection of complex 3D actions on the image plane and the inaccurate alignment are the major issues in the FER process. This paper presents the novel Multi-Angle Optimal Pattern-based Deep Learning (MAOP-DL) method to rectify the problem from sudden illumination changes, find the proper alignment of a feature set by using multi-angle-based optimal configurations. The proposed method includes the five major processes as Extended Boundary Background Subtraction (EBBS), Multi-Angle Texture Pattern+STM, Densely Extracted SURF+Local Occupancy Pattern (LOP), Priority Particle Cuckoo Search Optimization (PPCSO) and Long Short-Term Memory -Convolutional Neural Network (LSTM-CNN). Initially, the EBBS algorithm subtracts the background and isolates the foreground from the images which overcome the illumination and pose variation. Then, the MATP-STM extracts the texture patterns and DESURF-LOP extracts the relevant key features of the facial points. The PPCSO algorithm selects the relevant features from the MATP-STM feature set to speed up the classification. The employment of LSTM-CNN predicts the required label for the facial expressions.The major key findings of the proposed work are clear image analysis, effective handling of pose/illumination variations and the facial alignment. The proposed MAOP-DL validates its effectiveness on two standard databases such as CK+ and MMI regarding various metrics and confirm their assurance of wide applicability in recent applications.
关键词Stm Surf Cnn Lstm
DOIhttp://dx.doi.org/10.1016/j.patrec.2017.06.025
引用统计
文献类型期刊论文
条目标识符http://ir.ia.ac.cn/handle/173211/21195
专题智能感知与计算研究中心
通讯作者Kaiqi Huang
作者单位1.CRIPAC & NLPR, CASIA, PR China
2.University of Chinese Academy of Sciences, PR China
推荐引用方式
GB/T 7714
Jain Deepak Kumar,Zhang Zhang,Huang Kaiqi,et al. Multi angle optimal pattern-based deep learning for automatic facial expression recognition[J]. Pattern Recognition Letters,2017(XX):1-9.
APA Jain Deepak Kumar,Zhang Zhang,Huang Kaiqi,&Kaiqi Huang.(2017).Multi angle optimal pattern-based deep learning for automatic facial expression recognition.Pattern Recognition Letters(XX),1-9.
MLA Jain Deepak Kumar,et al."Multi angle optimal pattern-based deep learning for automatic facial expression recognition".Pattern Recognition Letters .XX(2017):1-9.
条目包含的文件 下载所有文件
文件名称/大小 文献类型 版本类型 开放类型 使用许可
Multi angle optimal (1796KB)期刊论文作者接受稿开放获取CC BY-NC-SA浏览 下载
个性服务
推荐该条目
保存到收藏夹
查看访问统计
导出为Endnote文件
谷歌学术
谷歌学术中相似的文章
[Jain Deepak Kumar]的文章
[Zhang Zhang]的文章
[Huang Kaiqi]的文章
百度学术
百度学术中相似的文章
[Jain Deepak Kumar]的文章
[Zhang Zhang]的文章
[Huang Kaiqi]的文章
必应学术
必应学术中相似的文章
[Jain Deepak Kumar]的文章
[Zhang Zhang]的文章
[Huang Kaiqi]的文章
相关权益政策
暂无数据
收藏/分享
文件名: Multi angle optimal pattern-based deep learning for automatic facial expression recognition.pdf
格式: Adobe PDF
所有评论 (0)
暂无评论
 

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。