| Bifurcated Backbone Strategy for RGB-D Salient Object Detection | |
Zhai, Yingjie1; Fan, Deng-Ping1; Yang, Jufeng1; Borji, Ali2; Shao, Ling3; Han, Junwei4; Wang, Liang5
| |
| 发表期刊 | IEEE TRANSACTIONS ON IMAGE PROCESSING
 |
| ISSN | 1057-7149 |
| 2021 | |
| 卷号 | 30页码:8727-8742 |
| 通讯作者 | Yang, Jufeng() |
| 摘要 | Multi-level feature fusion is a fundamental topic in computer vision. It has been exploited to detect, segment and classify objects at various scales. When multi-level features meet multi-modal cues, the optimal feature aggregation and multi-modal learning strategy become a hot potato. In this paper, we leverage the inherent multi-modal and multi-level nature of RGB-D salient object detection to devise a novel Bifurcated Backbone Strategy Network (BBS-Net). Our architecture, is simple, efficient, and backbone-independent. In particular, first, we propose to regroup the multi-level features into teacher and student features using a bifurcated backbone strategy (BBS). Second, we introduce a depth-enhanced module (DEM) to excavate informative depth cues from the channel and spatial views. Then, RGB and depth modalities are fused in a complementary way. Extensive experiments show that BBS-Net significantly outperforms 18 state-of-the-art (SOTA) models on eight challenging datasets under five evaluation measures, demonstrating the superiority of our approach (similar to 4% improvement in S-measure vs. the top-ranked model: DMRA). In addition, we provide a comprehensive analysis on the generalization ability of different RGB-D datasets and provide a powerful training set for future research. The complete algorithm, benchmark results, and post-processing toolbox are publicly available at https://github.com/zyjwuyan/BBS-Net. |
| 关键词 | RGB-D salient object detection bifurcated backbone strategy multi-level features cascaded refinement |
| DOI | 10.1109/TIP.2021.3116793 |
| 关键词[WOS] | REGION DETECTION ; FUSION ; CONTRAST ; NETWORK ; IMAGE ; MODEL |
| 收录类别 | SCI |
| 语种 | 英语 |
| 资助项目 | National Key Research and Development Program of China[2018AAA0100403] ; NSFC[61876094] ; NSFC[U1933114] ; Natural Science Foundation of Tianjin, China[20JCJQJC00020] ; Natural Science Foundation of Tianjin, China[18JCYBJC15400] ; Natural Science Foundation of Tianjin, China[18ZXZNGX00110] |
| 项目资助者 | National Key Research and Development Program of China ; NSFC ; Natural Science Foundation of Tianjin, China |
| WOS研究方向 | Computer Science ; Engineering |
| WOS类目 | Computer Science, Artificial Intelligence ; Engineering, Electrical & Electronic |
| WOS记录号 | WOS:000711755100006 |
| 出版者 | IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC |
| 引用统计 | |
| 文献类型 | 期刊论文 |
| 条目标识符 | http://ir.ia.ac.cn/handle/173211/46277 |
| 专题 | 模式识别实验室 |
| 通讯作者 | Yang, Jufeng |
| 作者单位 | 1.Nankai Univ, Coll Comp Sci, Tianjin 300350, Peoples R China 2.Primer Technol Inc, San Francisco, CA 94111 USA 3.Incept Inst Artificial Intelligence, Abu Dhabi, U Arab Emirates 4.Northwestern Polytech Univ, Sch Automat, Xian 710072, Peoples R China 5.Chinese Acad Sci, CAS Ctr Excellence Brain Sci & Intelligence Techn, Inst Automat, Natl Lab Pattern Recognit, Beijing 100190, Peoples R China |
| 推荐引用方式 GB/T 7714 | Zhai, Yingjie,Fan, Deng-Ping,Yang, Jufeng,et al. Bifurcated Backbone Strategy for RGB-D Salient Object Detection[J]. IEEE TRANSACTIONS ON IMAGE PROCESSING,2021,30:8727-8742. |
| APA | Zhai, Yingjie.,Fan, Deng-Ping.,Yang, Jufeng.,Borji, Ali.,Shao, Ling.,...&Wang, Liang.(2021).Bifurcated Backbone Strategy for RGB-D Salient Object Detection.IEEE TRANSACTIONS ON IMAGE PROCESSING,30,8727-8742. |
| MLA | Zhai, Yingjie,et al."Bifurcated Backbone Strategy for RGB-D Salient Object Detection".IEEE TRANSACTIONS ON IMAGE PROCESSING 30(2021):8727-8742. |
| 条目包含的文件 | 条目无相关文件。 | |||||
除非特别说明，本系统中所有内容都受版权保护，并保留所有权利。
修改评论