PSGAN: Pose and Expression Robust Spatial-Aware GAN for Customizable Makeup Transfer | |
Jiang, Wentao1; Liu, Si1; Gao, Chen2; Cao, Jie3,4; He, Ran3,4; Feng, Jiashi5; Yan, Shuicheng6 | |
2020 | |
会议名称 | IEEE Conference on Computer Vision and Pattern Recognition |
会议日期 | 2020年6月16日 - 2020年6月18日 |
会议地点 | 网络会议 |
摘要 | In this paper, we address the makeup transfer task, which aims to transfer the makeup from a reference image to a source image. Existing methods have achieved promising progress in constrained scenarios, but transferring between images with large pose and expression differences is still challenging. Besides, they cannot realize customizable transfer that allows a controllable shade of makeup or specifies the part to transfer, which limits their applications. To address these issues, we propose Pose and expression robust Spatial-aware GAN (PSGAN). It first utilizes Makeup Distill Network to disentangle the makeup of the reference image as two spatial-aware makeup matrices. Then, Attentive Makeup Morphing module is introduced to specify how the makeup of a pixel in the source image is morphed from the reference image. With the makeup matrices and the source image, Makeup Apply Network is used to perform makeup transfer. Our PSGAN not only achieves state-of-the-art results even when large pose and expression differences exist but also is able to perform partial and shade-controllable makeup transfer. Both the code and a newly collected dataset containing facial images with various poses and expressions will be available at https://github.com/wtjiang98/PSGAN. |
收录类别 | EI |
语种 | 英语 |
文献类型 | 会议论文 |
条目标识符 | http://ir.ia.ac.cn/handle/173211/44731 |
专题 | 智能感知与计算研究中心 |
通讯作者 | Liu, Si |
作者单位 | 1.北京航空航天大学 2.中国科学院信息工程研究所 3.中国科学院自动化研究所 4.中国科学院大学 5.国立新加坡大学 6.依图科技 |
推荐引用方式 GB/T 7714 | Jiang, Wentao,Liu, Si,Gao, Chen,et al. PSGAN: Pose and Expression Robust Spatial-Aware GAN for Customizable Makeup Transfer[C],2020. |
条目包含的文件 | 下载所有文件 | |||||
文件名称/大小 | 文献类型 | 版本类型 | 开放类型 | 使用许可 | ||
Jiang 等。 - 2020 - PS(1732KB) | 会议论文 | 开放获取 | CC BY-NC-SA | 浏览 下载 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论