CASIA OpenIR  > 复杂系统认知与决策实验室  > 智能系统与工程
Global and local multi-modal feature mutual learning for retinal vessel segmentation
Xin Zhao1; Zhang Jing2; Qiaozhe Li2; Tengfei Zhao1; Yi Li3; Zifeng Wu4
Source PublicationPattern Recognition
Corresponding AuthorZhao, Tengfei(

Research on optical coherence tomography angiography (OCTA) images has received extensive attention in recent years since it provides more detailed information about retinal structures. The automatic segmentation of retinal vessel (RV) has become one of the key issues in the quantification of retinal indicators. To this end, there are various methods proposed with cutting-edge designs and techniques in the literature. However, most of them only learn features from single-modal data, despite the potential relation between data from different modalities. Clinically, 2D projection maps are more convenient for doctors to observe. Nevertheless, 3D volumes preserve the intrinsic retinal structure. We thus propose a novel multi-modal feature mutual learning framework that contains local mutual learning and global mutual learning capturing 2D and 3D information. In the framework, the 3D model and 2D model learn collaboratively and teach each other throughout the training process. Experimental results show that our method outperforms previous deep-learning methods in RV segmentation. The generalization experiments on the ROSE dataset demonstrate the portability and scalability of the proposed framework.

KeywordMutual learning Multi-modal learning OCTA images Retinal vessel segmentation
Indexed BySCI
WOS Research AreaComputer Science ; Engineering
WOS SubjectComputer Science, Artificial Intelligence ; Engineering, Electrical & Electronic
WOS IDWOS:001221811000001
Sub direction classification医学影像处理与分析
planning direction of the national heavy laboratory视觉信息处理
Paper associated data
Citation statistics
Document Type期刊论文
Corresponding AuthorTengfei Zhao
Affiliation1.University of Science and Technology Beijing
2.Institute of Automation, Chinese Academy of Sciences
3.Dalian University of Technology, Dalian, 116081, China
4.DeepWise AI Lab
Recommended Citation
GB/T 7714
Xin Zhao,Zhang Jing,Qiaozhe Li,et al. Global and local multi-modal feature mutual learning for retinal vessel segmentation[J]. Pattern Recognition,2024,151:110376.
APA Xin Zhao,Zhang Jing,Qiaozhe Li,Tengfei Zhao,Yi Li,&Zifeng Wu.(2024).Global and local multi-modal feature mutual learning for retinal vessel segmentation.Pattern Recognition,151,110376.
MLA Xin Zhao,et al."Global and local multi-modal feature mutual learning for retinal vessel segmentation".Pattern Recognition 151(2024):110376.
Files in This Item: Download All
File Name/Size DocType Version Access License
2.pdf(4182KB)期刊论文作者接受稿开放获取CC BY-NC-SAView Download
Related Services
Recommend this item
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Xin Zhao]'s Articles
[Zhang Jing]'s Articles
[Qiaozhe Li]'s Articles
Baidu academic
Similar articles in Baidu academic
[Xin Zhao]'s Articles
[Zhang Jing]'s Articles
[Qiaozhe Li]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Xin Zhao]'s Articles
[Zhang Jing]'s Articles
[Qiaozhe Li]'s Articles
Terms of Use
No data!
Social Bookmark/Share
File name: 2.pdf
Format: Adobe PDF
All comments (0)
No comment.

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.