Knowledge Commons of Institute of Automation,CAS
Autostereoscopic augmented reality visualization for depth perception in endoscopic surgery | |
Wang, Rong1,2; Geng, Zheng1; Zhang, Zhaoxing1; Pei, Renjing1,2; Meng, Xiangbing1,2; Wang Rong | |
发表期刊 | DISPLAYS |
2017-07-01 | |
卷号 | 48期号:0页码:50-60 |
文章类型 | Article |
摘要 | Augmented reality (AR) has received increasing attention in minimally invasive surgery (MIS) applications. The goal of applying AR techniques to MIS is to enhance a surgeon's perception of the spatial relationship by overlaying invisible structures (e.g. tumor or vessels) onto the in vivo endoscopic video acquired during the surgery. One of primary issues of AR visualization is to provide correct depth perception for visible and invisible structures. In this paper, we present a video-based AR system consisting of functional modules for real-time 3D surface capture, reconstruction, and registration with pre-operative segmented CT model. The real-time 3D registration allows precise overlay of invisible structures onto 2D video for AR visualization. The AR overlay result is displayed on a multi-view autostereoscopic lenticular LCD. To study and compare the efficacy of AR visualization techniques, we investigated five different AR visualization modes. Both simulated and in vivo experiments were carried out and autostereoscopic AR visualization results were given. Evaluation and comparison for depth perception between five AR visualization modes are presented. Finally, we conclude the characteristics of these visualization modes. The novelty of our work lies in successful implementation of an end-to-end 3D autostereoscopic AR system from real-time reconstruction and registration with our multi-channel 3D endoscope, and systematic evaluation and comparison of five different visualization modes for depth perception. (C) 2017 Elsevier B.V. All rights reserved. |
关键词 | Visualization Augmented Reality Autostereoscopic 3d Display Depth Perception |
WOS标题词 | Science & Technology ; Technology ; Physical Sciences |
DOI | 10.1016/j.displa.2017.03.003 |
关键词[WOS] | LAPAROSCOPIC PARTIAL NEPHRECTOMY ; IMAGE-GUIDED SURGERY ; REGISTRATION ; NAVIGATION ; DISPLAY ; OVERLAY |
收录类别 | SCI |
语种 | 英语 |
项目资助者 | Institute of Automation, Chinese Academy of Sciences (CASIA)(2012AA011903 ; National High-tech R&D Program (863 Program) of Institute of Automation ; 2015AA015905) |
WOS研究方向 | Computer Science ; Engineering ; Instruments & Instrumentation ; Optics |
WOS类目 | Computer Science, Hardware & Architecture ; Engineering, Electrical & Electronic ; Instruments & Instrumentation ; Optics |
WOS记录号 | WOS:000404312700007 |
引用统计 | |
文献类型 | 期刊论文 |
条目标识符 | http://ir.ia.ac.cn/handle/173211/15246 |
专题 | 多模态人工智能系统全国重点实验室_平行智能技术与系统团队 |
通讯作者 | Wang Rong |
作者单位 | 1.Chinese Acad Sci, Inst Automat, 95 Zhongguancun East Rd, Beijing 100190, Peoples R China 2.Univ Chinese Acad Sci, Beijing, Peoples R China |
第一作者单位 | 中国科学院自动化研究所 |
推荐引用方式 GB/T 7714 | Wang, Rong,Geng, Zheng,Zhang, Zhaoxing,et al. Autostereoscopic augmented reality visualization for depth perception in endoscopic surgery[J]. DISPLAYS,2017,48(0):50-60. |
APA | Wang, Rong,Geng, Zheng,Zhang, Zhaoxing,Pei, Renjing,Meng, Xiangbing,&Wang Rong.(2017).Autostereoscopic augmented reality visualization for depth perception in endoscopic surgery.DISPLAYS,48(0),50-60. |
MLA | Wang, Rong,et al."Autostereoscopic augmented reality visualization for depth perception in endoscopic surgery".DISPLAYS 48.0(2017):50-60. |
条目包含的文件 | 下载所有文件 | |||||
文件名称/大小 | 文献类型 | 版本类型 | 开放类型 | 使用许可 | ||
Autostereoscopic aug(3770KB) | 期刊论文 | 作者接受稿 | 开放获取 | CC BY-NC-SA | 浏览 下载 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论