CASIA OpenIR  > 多模态人工智能系统全国重点实验室  > 视频内容安全
Face swapping detection based on identity spatial constraints with weighted frequency division
Ai, Zupeng1; Peng, Chengwei2; Jiang, Jun3; Li, Zekun2; Li, Bing3,4
Source PublicationMULTIMEDIA SYSTEMS
ISSN0942-4962
2022-10-14
Pages14
Corresponding AuthorLi, Zekun(zekun0227@163.com)
AbstractThe generalization of face swapping detectors is necessary when applied to the practical applications. Although the most existing methods may achieve accuracy detection performance on the known forgeries, they fail to make the prediction when faced with unseen face manipulation methods. To alleviate the problem, we propose a novel and practical framework called Detection based on Identity Spatial Constraints with Weighted Frequency Division (DISC-WFD) through introducing the reference image, consisting of the backbone network, the shared Identity Semantic Encoder (ISE) and the corresponding Identity Spatial Constraint (ISC) branches. The ISE is utilized to measure the identity similarity between the input image and the reference image and generates identity spatial constraints. The constraints are imposed on ISC to focus on the high frequency and low-frequency identity-related areas for the discriminative information. The proposed method can significantly improve the performance and the generalization against the unseen manipulation methods. Furthermore, the cross-dataset experiments validate the superiority and the effectiveness of the DISC-WFD.
KeywordFace swapping Face manipulation Frequency division Identity constraints
DOI10.1007/s00530-022-01007-4
Indexed BySCI
Language英语
Funding ProjectNational Key Research and Development Program of China[2020AAA0106800] ; National Natural Science Foundation of China[62192785] ; National Natural Science Foundation of China[61902401] ; National Natural Science Foundation of China[61972071] ; National Natural Science Foundation of China[U1936204] ; National Natural Science Foundation of China[62122086] ; National Natural Science Foundation of China[62036011] ; National Natural Science Foundation of China[62192782] ; National Natural Science Foundation of China[61721004] ; Beijing Natural Science Foundation[M22005] ; CAS Key Research Program of Frontier Sciences[QYZDJ-SSW-JSC040] ; Youth Innovation Promotion Association, CAS
Funding OrganizationNational Key Research and Development Program of China ; National Natural Science Foundation of China ; Beijing Natural Science Foundation ; CAS Key Research Program of Frontier Sciences ; Youth Innovation Promotion Association, CAS
WOS Research AreaComputer Science
WOS SubjectComputer Science, Information Systems ; Computer Science, Theory & Methods
WOS IDWOS:000868236300001
PublisherSPRINGER
Citation statistics
Document Type期刊论文
Identifierhttp://ir.ia.ac.cn/handle/173211/50294
Collection多模态人工智能系统全国重点实验室_视频内容安全
Corresponding AuthorLi, Zekun
Affiliation1.Univ Chinese Acad Sci, Sch Econ & Management, Beijing 100049, Peoples R China
2.Coordinat Ctr China, Natl Comp Network Emergency Response Tech Team, Beijing 100029, Peoples R China
3.Chinese Acad Sci, Inst Automat, Natl Lab Pattern Recognit, Beijing 100190, Peoples R China
4.People AI Inc, Beijing 100080, Peoples R China
Recommended Citation
GB/T 7714
Ai, Zupeng,Peng, Chengwei,Jiang, Jun,et al. Face swapping detection based on identity spatial constraints with weighted frequency division[J]. MULTIMEDIA SYSTEMS,2022:14.
APA Ai, Zupeng,Peng, Chengwei,Jiang, Jun,Li, Zekun,&Li, Bing.(2022).Face swapping detection based on identity spatial constraints with weighted frequency division.MULTIMEDIA SYSTEMS,14.
MLA Ai, Zupeng,et al."Face swapping detection based on identity spatial constraints with weighted frequency division".MULTIMEDIA SYSTEMS (2022):14.
Files in This Item:
There are no files associated with this item.
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Ai, Zupeng]'s Articles
[Peng, Chengwei]'s Articles
[Jiang, Jun]'s Articles
Baidu academic
Similar articles in Baidu academic
[Ai, Zupeng]'s Articles
[Peng, Chengwei]'s Articles
[Jiang, Jun]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Ai, Zupeng]'s Articles
[Peng, Chengwei]'s Articles
[Jiang, Jun]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.