Facial image super-resolution guided by adaptive geometric features | |
Fan, Zhenfeng1,2![]() ![]() ![]() ![]() ![]() | |
发表期刊 | EURASIP Journal on Wireless Communications and Networking
![]() |
ISSN | 1687-1472 |
2020-07-17 | |
卷号 | 2020期号:1页码:15 |
产权排序 | 1 |
摘要 | This paper addresses the traditional issue of restoring a high-resolution (HR) facial image from a low-resolution (LR) counterpart. Current state-of-the-art super-resolution (SR) methods commonly adopt the convolutional neural networks to learn a non-linear complex mapping between paired LR and HR images. They discriminate local patterns expressed by the neighboring pixels along the planar directions but ignore the intrinsic 3D proximity including the depth map. As a special case of general images, the face has limited geometric variations, which we believe that the relevant depth map can be learned and used to guide the face SR task. Motivated by it, we design a network including two branches: one for auxiliary depth map estimation and the other for the main SR task. Adaptive geometric features are further learned from the depth map and used to modulate the mid-level features of the SR branch. The whole network is implemented in an end-to-end trainable manner under the extra supervision of depth map. The supervisory depth map is either a paired one from RGB-D scans or a reconstructed one by a 3D prior model of faces. The experiments demonstrate the effectiveness of the proposed method and achieve improved performance over the state of the arts. |
关键词 | Convolutional neural networks Depth map Face super-resolution |
DOI | 10.1186/s13638-020-01760-y |
关键词[WOS] | COMPUTATION OFFLOADING METHOD ; FACE RECOGNITION ; NETWORK |
收录类别 | SCI |
语种 | 英语 |
资助项目 | National Natural Science Foundation of China[61571438] ; National Key R&D Program of China[2017YFC0803505] ; National Key R&D Program of China[2017YFC0803505] ; National Natural Science Foundation of China[61571438] |
WOS研究方向 | Engineering ; Telecommunications |
WOS类目 | Engineering, Electrical & Electronic ; Telecommunications |
WOS记录号 | BMC:10.1186/s13638-020-01760-y |
出版者 | Springer International Publishing |
七大方向——子方向分类 | 图像视频处理与分析 |
引用统计 | |
文献类型 | 期刊论文 |
条目标识符 | http://ir.ia.ac.cn/handle/173211/40133 |
专题 | 智能制造技术与系统研究中心_多维数据分析(彭思龙)-技术团队 |
通讯作者 | Hu, Xiyuan |
作者单位 | 1.Institute of Automation, Chinese Academy of Sciences 2.University of Chinese Academy of Sciences |
第一作者单位 | 中国科学院自动化研究所 |
通讯作者单位 | 中国科学院自动化研究所 |
推荐引用方式 GB/T 7714 | Fan, Zhenfeng,Hu, Xiyuan,Chen, Chen,et al. Facial image super-resolution guided by adaptive geometric features[J]. EURASIP Journal on Wireless Communications and Networking,2020,2020(1):15. |
APA | Fan, Zhenfeng,Hu, Xiyuan,Chen, Chen,Wang, Xiaolian,&Peng, Silong.(2020).Facial image super-resolution guided by adaptive geometric features.EURASIP Journal on Wireless Communications and Networking,2020(1),15. |
MLA | Fan, Zhenfeng,et al."Facial image super-resolution guided by adaptive geometric features".EURASIP Journal on Wireless Communications and Networking 2020.1(2020):15. |
条目包含的文件 | 下载所有文件 | |||||
文件名称/大小 | 文献类型 | 版本类型 | 开放类型 | 使用许可 | ||
fan2020.pdf(4900KB) | 期刊论文 | 作者接受稿 | 开放获取 | CC BY-NC-SA | 浏览 下载 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论