CASIA OpenIR  > 智能系统与工程
SSAP: Single-Shot Instance Segmentation With Affinity Pyramid
Gao, Naiyu1,2; Shan, Yanhu3; Wang, Yupei1,2; Zhao, Xin1,2; Huang, Kaiqi1,2,4
Source PublicationIEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY
ISSN1051-8215
2021-02-01
Volume31Issue:2Pages:661-673
Abstract

Proposal-free instance segmentation methods mainly generate instance-agnostic semantic segmentation labels and instance-aware features to group pixels into different object instances. However, previous methods mostly employ separate modules for these two sub-tasks and require multiple passes for inference. In addition to the lack of efficiency, previous methods also failed to perform as well as proposal-based approaches. To this end, this work proposes a single-shot proposal-free instance segmentation method that requires only one single pass for prediction. Our method is based on learning an affinity pyramid, which computes the probability that two pixels belong to the same instance in a hierarchical manner. Moreover, incorporating with the learned affinity pyramid, a novel cascaded graph partition (CGP) module is presented to fuse the two predictions and segment instances efficiently. As an additional contribution, we conduct an experiment to demonstrate the benefits of proposal-free methods in capturing detailed structures from finely annotated training examples. Our approach is evaluated on the Cityscapes and COCO datasets and achieves state-of-the-art performance.

KeywordInstance segmentation panoptic segmentation pixel-pair affinity graph partition
DOI10.1109/TCSVT.2020.2985420
Indexed BySCI
Language英语
Funding ProjectNational Key Research and Development Program of China[2016YFB1001005] ; National Natural Science Foundation of China[61673375] ; National Natural Science Foundation of China[61721004] ; National Natural Science Foundation of China[61876181] ; Chinese Academy of Science[QYZDB-SSW-JSC006] ; Youth Innovation Promotion Association CAS
Funding OrganizationNational Key Research and Development Program of China ; National Natural Science Foundation of China ; Chinese Academy of Science ; Youth Innovation Promotion Association CAS
WOS Research AreaEngineering
WOS SubjectEngineering, Electrical & Electronic
WOS IDWOS:000615044400019
PublisherIEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
Citation statistics
Cited Times:3[WOS]   [WOS Record]     [Related Records in WOS]
Document Type期刊论文
Identifierhttp://ir.ia.ac.cn/handle/173211/43263
Collection智能系统与工程
Corresponding AuthorHuang, Kaiqi
Affiliation1.CRISE, Institute of Automation, Chinese Academy of Sciences 2
2.University of Chinese Academy of Sciences
3.Horizon Robotics, Inc.
4.CAS Center for Excellence in Brain Science and Intelligence Technology
First Author AffilicationInstitute of Automation, Chinese Academy of Sciences
Corresponding Author AffilicationInstitute of Automation, Chinese Academy of Sciences
Recommended Citation
GB/T 7714
Gao, Naiyu,Shan, Yanhu,Wang, Yupei,et al. SSAP: Single-Shot Instance Segmentation With Affinity Pyramid[J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY,2021,31(2):661-673.
APA Gao, Naiyu,Shan, Yanhu,Wang, Yupei,Zhao, Xin,&Huang, Kaiqi.(2021).SSAP: Single-Shot Instance Segmentation With Affinity Pyramid.IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY,31(2),661-673.
MLA Gao, Naiyu,et al."SSAP: Single-Shot Instance Segmentation With Affinity Pyramid".IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY 31.2(2021):661-673.
Files in This Item: Download All
File Name/Size DocType Version Access License
SSAP-TCSVT2021.pdf(4190KB)期刊论文作者接受稿开放获取CC BY-NC-SAView Download
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Gao, Naiyu]'s Articles
[Shan, Yanhu]'s Articles
[Wang, Yupei]'s Articles
Baidu academic
Similar articles in Baidu academic
[Gao, Naiyu]'s Articles
[Shan, Yanhu]'s Articles
[Wang, Yupei]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Gao, Naiyu]'s Articles
[Shan, Yanhu]'s Articles
[Wang, Yupei]'s Articles
Terms of Use
No data!
Social Bookmark/Share
File name: SSAP-TCSVT2021.pdf
Format: Adobe PDF
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.