Institutional Repository of Chinese Acad Sci, Inst Automat, Natl Lab Pattern Recognit, Beijing 100190, Peoples R China
High-quality 3D Reconstruction with Depth Super-resolution and Completion | |
Li JW(李建伟)1,2; Gao W(高伟)1,2; Wu YH(吴毅红)1,2 | |
发表期刊 | IEEE Access |
2019 | |
卷号 | 7期号:1页码:19370-19381 |
摘要 | 3D reconstruction is an important topic in computer vision with many applications, such as robotics and augmented reality. Since the raw depth images captured by consumer RGB-D cameras are often low-resolution, noisy, and incomplete. How to obtain high-quality 3D models with a consumer RGB-D camera is still a challenge for existing systems. In this paper, we propose a new depth super-resolution and completion (SRC) method implemented in deep learning framework, and build a high-quality 3D reconstruction system. We first improve the resolution of low-resolution (LR) depth image with a depth super-resolution network, and remove the outliers in high-resolution (HR) depth image based on gradient saliency. To further enhance the quality of HR depth image with the guide of HR color image, we learn surface normal and occlusion boundary images from the corresponding HR color image through two deep fully convolutional networks (FCN). In particular, the blurriness of HR color image is also detected and pixel-wise quantized. Finally, we obtain a completed HR depth image by optimizing the HR depth image with surface normal, occlusion boundary and color image blurriness. We have carried out qualitative and quantitative evaluations with baseline methods on public datasets. Experimental results demonstrate that our method has better performance both on single depth image enhancement and 3D reconstruction. |
关键词 | Deep Learning Super-resolution Image Processing Depth Completion 3d Reconstruction |
收录类别 | SCIE |
语种 | 英语 |
WOS记录号 | WOS:000459939900001 |
七大方向——子方向分类 | 三维视觉 |
引用统计 | |
文献类型 | 期刊论文 |
条目标识符 | http://ir.ia.ac.cn/handle/173211/23361 |
专题 | 模式识别国家重点实验室_机器人视觉 |
通讯作者 | Gao W(高伟) |
作者单位 | 1.中科院自动化研究所 2.中国科学院大学 |
第一作者单位 | 中国科学院自动化研究所 |
通讯作者单位 | 中国科学院自动化研究所 |
推荐引用方式 GB/T 7714 | Li JW,Gao W,Wu YH. High-quality 3D Reconstruction with Depth Super-resolution and Completion[J]. IEEE Access,2019,7(1):19370-19381. |
APA | Li JW,Gao W,&Wu YH.(2019).High-quality 3D Reconstruction with Depth Super-resolution and Completion.IEEE Access,7(1),19370-19381. |
MLA | Li JW,et al."High-quality 3D Reconstruction with Depth Super-resolution and Completion".IEEE Access 7.1(2019):19370-19381. |
条目包含的文件 | 下载所有文件 | |||||
文件名称/大小 | 文献类型 | 版本类型 | 开放类型 | 使用许可 | ||
FINAL Article.pdf(4152KB) | 期刊论文 | 作者接受稿 | 开放获取 | CC BY-NC-SA | 浏览 下载 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论