CASIA OpenIR  > 智能感知与计算研究中心
One shot face swapping on megapixels
Zhu, Yuhao; Li, Qi; Wang, Jian; Xu, Chengzhong; Sun, Zhenan
Conference NameIEEE/CVF Conference on Computer Vision and Pattern Recognition
Conference Date2021
Conference PlaceUSA

Face swapping has both positive applications such as entertainment, human-computer interaction, etc., and negative applications such as DeepFake threats to politics, economics, etc. Nevertheless, it is necessary to understand the scheme of advanced methods for high-quality face swapping and generate enough and representative face swapping images to train DeepFake detection algorithms. This paper proposes the first Megapixel level method for one shot Face Swapping (or MegaFS for short). Firstly, MegaFS organizes face representation hierarchically by the proposed Hierarchical Representation Face Encoder (HieRFE) in an extended latent space to maintain more facial details, rather than compressed representation in previous face swapping methods. Secondly, a carefully designed Face Transfer Module (FTM) is proposed to transfer the identity from a source image to the target by a non-linear trajectory without explicit feature disentanglement. Finally, the swapped faces can be synthesized by StyleGAN2 with the benefits of its training stability and powerful generative capability. Each part of MegaFS can be trained separately so the requirement of our model for GPU memory can be satisfied for megapixel face swapping. In summary, complete face representation, stable training, and limited memory usage are the three novel contributions to the success of our method. Extensive experiments demonstrate the superiority of MegaFS and the first megapixel level face swapping database is released for research on DeepFake detection and face image editing in the public domain.

IS Representative Paper
Sub direction classification生物特征识别
planning direction of the national heavy laboratory视觉信息处理
Paper associated data
Document Type会议论文
Corresponding AuthorLi, Qi
AffiliationInstitute of Automation, Chinese Academy of Sciences
Recommended Citation
GB/T 7714
Zhu, Yuhao,Li, Qi,Wang, Jian,et al. One shot face swapping on megapixels[C],2021.
Files in This Item:
File Name/Size DocType Version Access License
Zhu_One_Shot_Face_Sw(7327KB)会议论文 开放获取CC BY-NC-SAView
Related Services
Recommend this item
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Zhu, Yuhao]'s Articles
[Li, Qi]'s Articles
[Wang, Jian]'s Articles
Baidu academic
Similar articles in Baidu academic
[Zhu, Yuhao]'s Articles
[Li, Qi]'s Articles
[Wang, Jian]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Zhu, Yuhao]'s Articles
[Li, Qi]'s Articles
[Wang, Jian]'s Articles
Terms of Use
No data!
Social Bookmark/Share
File name: Zhu_One_Shot_Face_Swapping_on_Megapixels_CVPR_2021_paper.pdf
Format: Adobe PDF
All comments (0)
No comment.

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.