MU-GAN: Facial Attribute Editing Based on Multi-Attention Mechanism

doi:10.1109/JAS.2020.1003390

CASIA OpenIR > 学术期刊 > IEEE/CAA Journal of Automatica Sinica

	MU-GAN: Facial Attribute Editing Based on Multi-Attention Mechanism
	Ke Zhang; Yukun Su; Xiwang Guo; Liang Qi; Zhenbing Zhao
发表期刊	IEEE/CAA Journal of Automatica Sinica
ISSN	2329-9266
	2021
卷号	8 期号:9 页码:1614-1626
摘要	Facial attribute editing has mainly two objectives: 1) translating image from a source domain to a target one, and 2) only changing the facial regions related to a target attribute and preserving the attribute-excluding details. In this work, we propose a multi-attention U-Net-based generative adversarial network (MU-GAN). First, we replace a classic convolutional encoder-decoder with a symmetric U-Net-like structure in a generator, and then apply an additive attention mechanism to build attention-based U-Net connections for adaptively transferring encoder representations to complement a decoder with attribute-excluding detail and enhance attribute editing ability. Second, a self-attention (SA) mechanism is incorporated into convolutional layers for modeling long-range and multi-level dependencies across image regions. Experimental results indicate that our method is capable of balancing attribute editing ability and details preservation ability, and can decouple the correlation among attributes. It outperforms the state-of-the-art methods in terms of attribute manipulation accuracy and image quality. Our code is available at https://github.com/SuSir1996/MU-GAN.
关键词	Attention U-Net connection encoder-decoder architecture facial attribute editing multi-attention mechanism
DOI	10.1109/JAS.2020.1003390
引用统计	被引频次：18[WOS] [WOS记录] [WOS相关记录]
文献类型	期刊论文
条目标识符	http://ir.ia.ac.cn/handle/173211/45376
专题	学术期刊_IEEE/CAA Journal of Automatica Sinica
推荐引用方式 GB/T 7714	Ke Zhang,Yukun Su,Xiwang Guo,et al. MU-GAN: Facial Attribute Editing Based on Multi-Attention Mechanism[J]. IEEE/CAA Journal of Automatica Sinica,2021,8(9):1614-1626.
APA	Ke Zhang,Yukun Su,Xiwang Guo,Liang Qi,&Zhenbing Zhao.(2021).MU-GAN: Facial Attribute Editing Based on Multi-Attention Mechanism.IEEE/CAA Journal of Automatica Sinica,8(9),1614-1626.
MLA	Ke Zhang,et al."MU-GAN: Facial Attribute Editing Based on Multi-Attention Mechanism".IEEE/CAA Journal of Automatica Sinica 8.9(2021):1614-1626.

条目包含的文件		下载所有文件
文件名称/大小	文献类型	版本类型	开放类型	使用许可
JAS-2020-0526.pdf（13892KB）	期刊论文	出版稿	开放获取	CC BY-NC-SA	浏览下载