Local and Global Perception Generative Adversarial Network for Facial Expression Synthesis

doi:10.1109/TCSVT.2021.3074032

CASIA OpenIR > 多模态人工智能系统全国重点实验室 > 平行智能技术与系统团队

	Local and Global Perception Generative Adversarial Network for Facial Expression Synthesis
	Xia, Yifan 1; Zheng, Wenbo 2,3; Wang, Yiming 1; Yu, Hui 1; Dong, Junyu 4; Wang, Fei-Yue5,6,7
发表期刊	IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY
ISSN	1051-8215
	2022-03-01
卷号	32 期号:3 页码:1443-1452
通讯作者	Yu, Hui(hui.yu@port.ac.uk)
摘要	Facial expression synthesis has gained increasing attention with the development of Generative Adversarial Networks (GANs). However, it is still very challenging to generate high-quality facial expressions since the overlapping and blur commonly appear in the generated facial images especially in the regions with rich facial features such as eye and mouth. Generally, existing methods mainly consider the face as a whole in facial expression synthesis without paying specific attention to the characteristics of facial expressions. In fact, according to the physiological and psychological research, the differences of facial expressions often appear in crucial regions such as eye and mouth. Motivated by this observation, a novel end-to-end facial expression synthesis method called Local and Global Perception Generative Adversarial Network (LGP-GAN) with a two-stage cascaded structure is proposed in this paper which is designed to extract and synthesize the details of the crucial facial regions. LGP-GAN can combine the generated results from the global network and local network into the corresponding facial expressions. In Stage I, LGP-GAN utilizes local networks to capture the local texture details of the crucial facial regions and generate local facial regions, which fully explores crucial facial region domain information in facial expressions. And then LGP-GAN uses a global network to learn the whole facial information in Stage II to generate the generate final facial expressions building upon local generated results from Stage I. We conduct qualitative and quantitative experiments on the commonly used public database to verify the effectiveness of the proposed method. Experimental results show the superiority of the proposed method over the state-of-the-art methods.
关键词	Task analysis Face recognition Mouth Generative adversarial networks Facial features Generators Gallium nitride Facial expression synthesis generative adversarial networks facial expression recognition local facial region facial mask
DOI	10.1109/TCSVT.2021.3074032
关键词[WOS]	IMAGE SYNTHESIS ; DEEP
收录类别	SCI
语种	英语
资助项目	Engineering and Physical Sciences Research Council (EPSRC)[EP/N025849/1] ; Royal Academy of Engineering[IFS1819/9]
项目资助者	Engineering and Physical Sciences Research Council (EPSRC) ; Royal Academy of Engineering
WOS研究方向	Engineering
WOS类目	Engineering, Electrical & Electronic
WOS记录号	WOS:000766700400044
出版者	IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
引用统计	被引频次：26[WOS] [WOS记录] [WOS相关记录]
文献类型	期刊论文
条目标识符	http://ir.ia.ac.cn/handle/173211/48109
专题	多模态人工智能系统全国重点实验室_平行智能技术与系统团队
通讯作者	Yu, Hui
作者单位	1.Univ Portsmouth, Sch Creat Technol, Portsmouth PO1 2DJ, Hants, England 2.Xi An Jiao Tong Univ, Sch Software Engn, Xian 710049, Peoples R China 3.Chinese Acad Sci, Inst Automat, State Key Lab Management & Control Complex Syst, Beijing 100190, Peoples R China 4.Ocean Univ China, Dept Informat Sci & Technol, Qingdao 266100, Peoples R China 5.Macau Univ Sci & Technol, Inst Syst Engn, Macau 999078, Peoples R China 6.Qingdao Acad Intelligent Ind, Qingdao 266109, Peoples R China 7.Chinese Acad Sci, State Key Lab Management & Control Complex Syst, Inst Automat, Beijing 100190, Peoples R China
推荐引用方式 GB/T 7714	Xia, Yifan,Zheng, Wenbo,Wang, Yiming,et al. Local and Global Perception Generative Adversarial Network for Facial Expression Synthesis[J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY,2022,32(3):1443-1452.
APA	Xia, Yifan,Zheng, Wenbo,Wang, Yiming,Yu, Hui,Dong, Junyu,&Wang, Fei-Yue.(2022).Local and Global Perception Generative Adversarial Network for Facial Expression Synthesis.IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY,32(3),1443-1452.
MLA	Xia, Yifan,et al."Local and Global Perception Generative Adversarial Network for Facial Expression Synthesis".IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY 32.3(2022):1443-1452.