CASIA OpenIR  > 模式识别国家重点实验室  > 机器人视觉
High-quality 3D Reconstruction with Depth Super-resolution and Completion
Li JW(李建伟)1,2; Gao W(高伟)1,2; Wu YH(吴毅红)1,2
发表期刊IEEE Access
2019
卷号7期号:1页码:19370-19381
摘要
3D reconstruction is an important topic in computer vision with many applications, such as robotics and augmented reality. Since the raw depth images captured by consumer RGB-D cameras are often low-resolution, noisy, and incomplete. How to obtain high-quality 3D models with a consumer RGB-D camera is still a challenge for existing systems. In this paper, we propose a new depth super-resolution and completion (SRC) method implemented in deep learning framework, and build a high-quality 3D reconstruction system. We first improve the resolution of low-resolution (LR) depth image with a depth super-resolution network, and remove the outliers in high-resolution (HR) depth image based on gradient saliency. To further enhance the quality of HR depth image with the guide of HR color image, we learn surface normal and occlusion boundary images from the corresponding HR color image through two deep fully convolutional networks (FCN). In particular, the blurriness of HR color image is also detected and pixel-wise quantized. Finally, we obtain a completed HR depth image by optimizing the HR depth image with surface normal, occlusion boundary and color image blurriness. We have carried out qualitative and quantitative evaluations with baseline methods on public datasets. Experimental results demonstrate that our method has better performance both on single depth image enhancement and 3D reconstruction.
关键词Deep Learning Super-resolution Image Processing Depth Completion 3d Reconstruction
收录类别SCIE
语种英语
WOS记录号WOS:000459939900001
七大方向——子方向分类三维视觉
引用统计
被引频次:11[WOS]   [WOS记录]     [WOS相关记录]
文献类型期刊论文
条目标识符http://ir.ia.ac.cn/handle/173211/23361
专题模式识别国家重点实验室_机器人视觉
通讯作者Gao W(高伟)
作者单位1.中科院自动化研究所
2.中国科学院大学
第一作者单位中国科学院自动化研究所
通讯作者单位中国科学院自动化研究所
推荐引用方式
GB/T 7714
Li JW,Gao W,Wu YH. High-quality 3D Reconstruction with Depth Super-resolution and Completion[J]. IEEE Access,2019,7(1):19370-19381.
APA Li JW,Gao W,&Wu YH.(2019).High-quality 3D Reconstruction with Depth Super-resolution and Completion.IEEE Access,7(1),19370-19381.
MLA Li JW,et al."High-quality 3D Reconstruction with Depth Super-resolution and Completion".IEEE Access 7.1(2019):19370-19381.
条目包含的文件 下载所有文件
文件名称/大小 文献类型 版本类型 开放类型 使用许可
FINAL Article.pdf(4152KB)期刊论文作者接受稿开放获取CC BY-NC-SA浏览 下载
个性服务
推荐该条目
保存到收藏夹
查看访问统计
导出为Endnote文件
谷歌学术
谷歌学术中相似的文章
[Li JW(李建伟)]的文章
[Gao W(高伟)]的文章
[Wu YH(吴毅红)]的文章
百度学术
百度学术中相似的文章
[Li JW(李建伟)]的文章
[Gao W(高伟)]的文章
[Wu YH(吴毅红)]的文章
必应学术
必应学术中相似的文章
[Li JW(李建伟)]的文章
[Gao W(高伟)]的文章
[Wu YH(吴毅红)]的文章
相关权益政策
暂无数据
收藏/分享
文件名: FINAL Article.pdf
格式: Adobe PDF
此文件暂不支持浏览
所有评论 (0)
暂无评论
 

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。