Autostereoscopic augmented reality visualization for depth perception in endoscopic surgery
Wang, Rong1,2; Geng, Zheng1; Zhang, Zhaoxing1; Pei, Renjing1,2; Meng, Xiangbing1,2; Wang Rong
Source PublicationDISPLAYS
AbstractAugmented reality (AR) has received increasing attention in minimally invasive surgery (MIS) applications. The goal of applying AR techniques to MIS is to enhance a surgeon's perception of the spatial relationship by overlaying invisible structures (e.g. tumor or vessels) onto the in vivo endoscopic video acquired during the surgery. One of primary issues of AR visualization is to provide correct depth perception for visible and invisible structures. In this paper, we present a video-based AR system consisting of functional modules for real-time 3D surface capture, reconstruction, and registration with pre-operative segmented CT model. The real-time 3D registration allows precise overlay of invisible structures onto 2D video for AR visualization. The AR overlay result is displayed on a multi-view autostereoscopic lenticular LCD. To study and compare the efficacy of AR visualization techniques, we investigated five different AR visualization modes. Both simulated and in vivo experiments were carried out and autostereoscopic AR visualization results were given. Evaluation and comparison for depth perception between five AR visualization modes are presented. Finally, we conclude the characteristics of these visualization modes. The novelty of our work lies in successful implementation of an end-to-end 3D autostereoscopic AR system from real-time reconstruction and registration with our multi-channel 3D endoscope, and systematic evaluation and comparison of five different visualization modes for depth perception. (C) 2017 Elsevier B.V. All rights reserved.
KeywordVisualization Augmented Reality Autostereoscopic 3d Display Depth Perception
WOS HeadingsScience & Technology ; Technology ; Physical Sciences
Indexed BySCI
Funding OrganizationInstitute of Automation, Chinese Academy of Sciences (CASIA)(2012AA011903 ; National High-tech R&D Program (863 Program) of Institute of Automation ; 2015AA015905)
WOS Research AreaComputer Science ; Engineering ; Instruments & Instrumentation ; Optics
WOS SubjectComputer Science, Hardware & Architecture ; Engineering, Electrical & Electronic ; Instruments & Instrumentation ; Optics
WOS IDWOS:000404312700007
Citation statistics
Cited Times:2[WOS]   [WOS Record]     [Related Records in WOS]
Document Type期刊论文
Corresponding AuthorWang Rong
Affiliation1.Chinese Acad Sci, Inst Automat, 95 Zhongguancun East Rd, Beijing 100190, Peoples R China
2.Univ Chinese Acad Sci, Beijing, Peoples R China
Recommended Citation
GB/T 7714
Wang, Rong,Geng, Zheng,Zhang, Zhaoxing,et al. Autostereoscopic augmented reality visualization for depth perception in endoscopic surgery[J]. DISPLAYS,2017,48(0):50-60.
APA Wang, Rong,Geng, Zheng,Zhang, Zhaoxing,Pei, Renjing,Meng, Xiangbing,&Wang Rong.(2017).Autostereoscopic augmented reality visualization for depth perception in endoscopic surgery.DISPLAYS,48(0),50-60.
MLA Wang, Rong,et al."Autostereoscopic augmented reality visualization for depth perception in endoscopic surgery".DISPLAYS 48.0(2017):50-60.
Files in This Item: Download All
File Name/Size DocType Version Access License
Autostereoscopic aug(3770KB)期刊论文作者接受稿开放获取CC BY-NC-SAView Download
Related Services
Recommend this item
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Wang, Rong]'s Articles
[Geng, Zheng]'s Articles
[Zhang, Zhaoxing]'s Articles
Baidu academic
Similar articles in Baidu academic
[Wang, Rong]'s Articles
[Geng, Zheng]'s Articles
[Zhang, Zhaoxing]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Wang, Rong]'s Articles
[Geng, Zheng]'s Articles
[Zhang, Zhaoxing]'s Articles
Terms of Use
No data!
Social Bookmark/Share
File name: Autostereoscopic augmented reality visualization for depth perception in endoscopic surgery.pdf
Format: Adobe PDF
All comments (0)
No comment.

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.