CASIA OpenIR  > 复杂系统管理与控制国家重点实验室  > 先进机器人
Real-Time Multi-Guidewire Endpoint Localization in Fluoroscopy Images
Li, Rui-Qi1,2; Xie, Xiao-Liang1,2; Zhou, Xiao-Hu1,2; Liu, Shi-Qi1,2; Ni, Zhen-Liang1,2; Zhou, Yan-Jie1,2; Bian, Gui-Bin1,2; Hou, Zeng-Guang1,2,3,4
Source PublicationIEEE TRANSACTIONS ON MEDICAL IMAGING
ISSN0278-0062
2021-08-01
Volume40Issue:8Pages:2002-2014
Abstract

The real-time localization of the guidewire endpoints is a stepping stone to computer-assisted percutaneous coronary intervention (PCI). However, methods for multi-guidewire endpoint localization in fluoroscopy images are still scarce. In this paper, we introduce a framework for real-time multi-guidewire endpoint localization in fluoroscopy images. The framework consists of two stages, first detecting all guidewire instances in the fluoroscopy image, and then locating the endpoints of each single guidewire instance. In the first stage, a YOLOv3 detector is used for guidewire detection, and a post-processing algorithm is proposed to refine the guidewire detection results. In the second stage, a Segmentation Attention-hourglass (SA-hourglass) network is proposed to predict the endpoint locations of each single guidewire instance. The SA-hourglass network can be generalized to the keypoint localization of other surgical instruments. In our experiments, the SA-hourglass network is applied not only on a guidewire dataset but also on a retinal microsurgery dataset, reaching the mean pixel error (MPE) of 2.20 pixels on the guidewire dataset and the MPE of 5.30 pixels on the retinal microsurgery dataset, both achieving the state-of-the-art localization results. Besides, the inference rate of our framework is at least 20FPS, which meets the real-time requirement of fluoroscopy images (6-12FPS).

KeywordLocation awareness Surgery Instruments Task analysis Detectors Real-time systems Retina Guidewire endpoint keypoint localization surgical instrument
DOI10.1109/TMI.2021.3069998
Indexed BySCI
Language英语
Funding ProjectNational Natural Science Foundation of China[62073325] ; National Natural Science Foundation of China[62003343] ; National Natural Science Foundation of China[U1913601] ; National Natural Science Foundation of China[U20A20224] ; National Key Research and Development Program of China[2019YFB1311700] ; Youth Innovation Promotion Association of CAS[2020140] ; Strategic Priority Research Program of CAS[XDB32040000]
Funding OrganizationNational Natural Science Foundation of China ; National Key Research and Development Program of China ; Youth Innovation Promotion Association of CAS ; Strategic Priority Research Program of CAS
WOS Research AreaComputer Science ; Engineering ; Imaging Science & Photographic Technology ; Radiology, Nuclear Medicine & Medical Imaging
WOS SubjectComputer Science, Interdisciplinary Applications ; Engineering, Biomedical ; Engineering, Electrical & Electronic ; Imaging Science & Photographic Technology ; Radiology, Nuclear Medicine & Medical Imaging
WOS IDWOS:000679532100005
PublisherIEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
Sub direction classification多模态智能
Citation statistics
Cited Times:1[WOS]   [WOS Record]     [Related Records in WOS]
Document Type期刊论文
Identifierhttp://ir.ia.ac.cn/handle/173211/45667
Collection复杂系统管理与控制国家重点实验室_先进机器人
中国科学院自动化研究所
Corresponding AuthorHou, Zeng-Guang
Affiliation1.Chinese Acad Sci, Inst Automat, State Key Lab Management & Control Complex Syst, Beijing 100190, Peoples R China
2.Univ Chinese Acad Sci, Sch Artificial Intelligence, Beijing 100049, Peoples R China
3.CAS Ctr Excellence Brain Sci & Technol, Beijing 100190, Peoples R China
4.Macau Univ Sci & Technol, Inst Syst Engn, CAS MUST Joint Lab Intelligence Sci & Technol, Macau 999078, Peoples R China
First Author AffilicationInstitute of Automation, Chinese Academy of Sciences
Corresponding Author AffilicationInstitute of Automation, Chinese Academy of Sciences
Recommended Citation
GB/T 7714
Li, Rui-Qi,Xie, Xiao-Liang,Zhou, Xiao-Hu,et al. Real-Time Multi-Guidewire Endpoint Localization in Fluoroscopy Images[J]. IEEE TRANSACTIONS ON MEDICAL IMAGING,2021,40(8):2002-2014.
APA Li, Rui-Qi.,Xie, Xiao-Liang.,Zhou, Xiao-Hu.,Liu, Shi-Qi.,Ni, Zhen-Liang.,...&Hou, Zeng-Guang.(2021).Real-Time Multi-Guidewire Endpoint Localization in Fluoroscopy Images.IEEE TRANSACTIONS ON MEDICAL IMAGING,40(8),2002-2014.
MLA Li, Rui-Qi,et al."Real-Time Multi-Guidewire Endpoint Localization in Fluoroscopy Images".IEEE TRANSACTIONS ON MEDICAL IMAGING 40.8(2021):2002-2014.
Files in This Item: Download All
File Name/Size DocType Version Access License
Real-Time_Multi-Guid(2266KB)期刊论文作者接受稿开放获取CC BY-NC-SAView Download
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Li, Rui-Qi]'s Articles
[Xie, Xiao-Liang]'s Articles
[Zhou, Xiao-Hu]'s Articles
Baidu academic
Similar articles in Baidu academic
[Li, Rui-Qi]'s Articles
[Xie, Xiao-Liang]'s Articles
[Zhou, Xiao-Hu]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Li, Rui-Qi]'s Articles
[Xie, Xiao-Liang]'s Articles
[Zhou, Xiao-Hu]'s Articles
Terms of Use
No data!
Social Bookmark/Share
File name: Real-Time_Multi-Guidewire_Endpoint_Localization_in_Fluoroscopy_Images.pdf
Format: Adobe PDF
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.