CASIA OpenIR  > 智能感知与计算研究中心
Conditional Expression Synthesis with Face Parsing Transformation
Zhihe Lu1,2,3; Tanhao Hu1; Lingxiao Song1,4; Zhaoxiang Zhang1,2,3; Ran He1,2,3
2018-10-22
Conference NameACM Multimedia conference
Conference Date2018.10.22-2018.10.26
Conference PlaceSeoul, Korea
Abstract

Facial expression synthesis with various intensities is a challenging synthesis task due to large identity appearance variations and a paucity of efcient means for intensity measurement. This paper advances the expression synthesis domain by the introduction of a Couple-Agent Face Parsing based Generative Adversarial Network (CAFP-GAN) that unites the knowledge of facial semantic regions and controllable expression signals. Specially, we employ a face parsing map as a controllable condition to guide facial texture generation with a special expression, which can provide a semantic representation of every pixel of facial regions. Our method consists of two sub-networks: face parsing prediction network (FPPN) uses controllable labels (expression and intensity) to generate a face parsing map transformation that corresponds to the labels from the input neutral face, and facial expression synthesis network (FESN) makes the pretrained FPPN as a part of it to provide the face parsing map as a guidance for expression synthesis. To enhance the reality of results, couple-agent discriminators are served to distinguish fake-real pairs in both two sub-nets. Moreover, we only need the neutral face and the labels to synthesize the unknown expression with different intensities. Experimental results on three popular facial expression databases show that our method has the compelling ability on continuous expression synthesis.

KeywordFace Parsing Expression Synthesis Generative Adversarial Network
Indexed ByEI
Language英语
Document Type会议论文
Identifierhttp://ir.ia.ac.cn/handle/173211/23532
Collection智能感知与计算研究中心
Corresponding AuthorRan He
Affiliation1.Center for Research on Intelligent Perception and Computing, CASIA
2.Center for Excellence in Brain Science and Intelligence Technology, CAS
3.University of Chinese Academy of Sciences, Beijing, 100049, China
4.Boomhope Information and Technology Co., Ltd
First Author AffilicationChinese Acad Sci, Inst Automat, Natl Lab Pattern Recognit, Beijing 100190, Peoples R China
Corresponding Author AffilicationChinese Acad Sci, Inst Automat, Natl Lab Pattern Recognit, Beijing 100190, Peoples R China
Recommended Citation
GB/T 7714
Zhihe Lu,Tanhao Hu,Lingxiao Song,et al. Conditional Expression Synthesis with Face Parsing Transformation[C],2018.
Files in This Item: Download All
File Name/Size DocType Version Access License
Conditional expressi(3407KB)会议论文 开放获取CC BY-NC-SAView Download
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Zhihe Lu]'s Articles
[Tanhao Hu]'s Articles
[Lingxiao Song]'s Articles
Baidu academic
Similar articles in Baidu academic
[Zhihe Lu]'s Articles
[Tanhao Hu]'s Articles
[Lingxiao Song]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Zhihe Lu]'s Articles
[Tanhao Hu]'s Articles
[Lingxiao Song]'s Articles
Terms of Use
No data!
Social Bookmark/Share
File name: Conditional expression synthesis with face parsing transformation.pdf
Format: Adobe PDF
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.