CASIA OpenIR  > 复杂系统管理与控制国家重点实验室  > 先进机器人
SurgiNet: Pyramid Attention Aggregation and Class-wise Self-Distillation for Surgical Instrument Segmentation
Ni, Zhen-Liang1,2; Zhou, Xiao-Hu2; Wang, Guan-An1,2; Yue, Wen-Qian2; Li, Zhen2; Bian, Gui-Bin1,2; Hou, Zeng-Guang1,2,3
Source PublicationMEDICAL IMAGE ANALYSIS
ISSN1361-8415
2022-02-01
Volume76Pages:102310
Abstract

Surgical instrument segmentation plays a promising role in robot-assisted surgery. However, illumination issues often appear in surgical scenes, altering the color and texture of surgical instruments. Changes in visual features make surgical instrument segmentation difficult. To address illumination issues, the SurgiNet is proposed to learn pyramid attention features. The double attention module is designed to capture the semantic dependencies between locations and channels. Based on semantic dependencies, the semantic features in the disturbed area can be inferred for addressing illumination issues. Pyramid attention is aggregated to capture multi-scale features and make predictions more accurate. To perform model compression, class-wise self-distillation is proposed to enhance the representation learning of the network, which performs feature distillation within the class to eliminate interference from other classes. Top-down and multi-stage knowledge distillation is designed to distill class probability maps. By inter layer supervision, high-level probability maps are applied to calibrate the probability distribution of lowlevel probability maps. Since class-wise distillation enhances the self-learning of the network, the network can get excellent performance with a lightweight backbone. The proposed network achieves the state-of-the-art performance of 89.14% mIoU on CataIS with only 1.66 GFlops and 2.05 M parameters. It also takes first place on EndoVis 2017 with 66.30% mIoU. 

KeywordSurgical Insturment Segmentation Class-wise Self-Distillation Pyramid Attention
DOI10.1016/j.media.2021.102310
Indexed BySCI
Language英语
Funding ProjectNational Natural Science Foundation of China[62027813] ; National Natural Science Foundation of China[62003343] ; National Natural Science Foundation of China[U1913210] ; National Natural Science Foundation of China[U1913601] ; National Natural Science Foundation of China[U1713220] ; Beijing Science and Technology Star[Z19110 0 0 01119046] ; Youth Innovation Promotion Association of the Chinese Academy of Sciences[2018165] ; Youth Innovation Promotion Association of the Chinese Academy of Sciences[2020140]
Funding OrganizationNational Natural Science Foundation of China ; Beijing Science and Technology Star ; Youth Innovation Promotion Association of the Chinese Academy of Sciences
WOS Research AreaComputer Science ; Engineering ; Radiology, Nuclear Medicine & Medical Imaging
WOS SubjectComputer Science, Artificial Intelligence ; Computer Science, Interdisciplinary Applications ; Engineering, Biomedical ; Radiology, Nuclear Medicine & Medical Imaging
WOS IDWOS:000742838900002
PublisherELSEVIER
Sub direction classification多模态智能
Citation statistics
Cited Times:6[WOS]   [WOS Record]     [Related Records in WOS]
Document Type期刊论文
Identifierhttp://ir.ia.ac.cn/handle/173211/47043
Collection复杂系统管理与控制国家重点实验室_先进机器人
Corresponding AuthorBian, Gui-Bin; Hou, Zeng-Guang
Affiliation1.Chinese Acad Sci, Inst Automat, State Key Lab Management & Control Complex Syst, Beijing 100190, Peoples R China
2.Univ Chinese Acad Sci, Sch Artificial Intelligence, Beijing, Peoples R China
3.Macau Univ Sci & Technol, Inst Syst Engn, Joint Lab Intelligence Sci & Technol, Macau, Peoples R China
First Author AffilicationInstitute of Automation, Chinese Academy of Sciences
Corresponding Author AffilicationInstitute of Automation, Chinese Academy of Sciences
Recommended Citation
GB/T 7714
Ni, Zhen-Liang,Zhou, Xiao-Hu,Wang, Guan-An,et al. SurgiNet: Pyramid Attention Aggregation and Class-wise Self-Distillation for Surgical Instrument Segmentation[J]. MEDICAL IMAGE ANALYSIS,2022,76:102310.
APA Ni, Zhen-Liang.,Zhou, Xiao-Hu.,Wang, Guan-An.,Yue, Wen-Qian.,Li, Zhen.,...&Hou, Zeng-Guang.(2022).SurgiNet: Pyramid Attention Aggregation and Class-wise Self-Distillation for Surgical Instrument Segmentation.MEDICAL IMAGE ANALYSIS,76,102310.
MLA Ni, Zhen-Liang,et al."SurgiNet: Pyramid Attention Aggregation and Class-wise Self-Distillation for Surgical Instrument Segmentation".MEDICAL IMAGE ANALYSIS 76(2022):102310.
Files in This Item: Download All
File Name/Size DocType Version Access License
MIA.pdf(1944KB)期刊论文作者接受稿开放获取CC BY-NC-SAView Download
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Ni, Zhen-Liang]'s Articles
[Zhou, Xiao-Hu]'s Articles
[Wang, Guan-An]'s Articles
Baidu academic
Similar articles in Baidu academic
[Ni, Zhen-Liang]'s Articles
[Zhou, Xiao-Hu]'s Articles
[Wang, Guan-An]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Ni, Zhen-Liang]'s Articles
[Zhou, Xiao-Hu]'s Articles
[Wang, Guan-An]'s Articles
Terms of Use
No data!
Social Bookmark/Share
File name: MIA.pdf
Format: Adobe PDF
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.