Knowledge Commons of Institute of Automation,CAS
Dual-stream Representation Fusion Learning for accurate medical image segmentation | |
Xu RT(许镕涛)1,3; Wang CW(王常维)1,3; Xu SB(徐士彪)2; Meng WL(孟维亮)1; Zhang XP(张晓鹏)1 | |
发表期刊 | Engineering Applications of Artificial Intelligence |
2023 | |
卷号 | 123页码:106402 |
摘要 | Accurate segmenting regions of interest in various medical images are essential to clinical research and applications. Although deep learning-based methods have achieved good results, the fully automated segmentation results still need to be refined on the tininess, complexities, and irregularities of lesion shapes. To address this issue, we propose a Dual-stream Representation Fusion Learning (DRFL) paradigm for accurate clinical segmentation, including Dual-stream Fusion Module, Representation Fusion Transformer Module and Peakiness Fusion Attention Module. Specifically, Dual-stream Fusion Module can simultaneously generate binary masks and high-resolution images with segmentation stream and super-resolution stream that share a feature extractor, then both prediction outputs are merged as the input of Fusion Module to further improve the performance of the network for generating the final segmentation result; Representation Fusion Transformer Module is lightweight to fuse high-resolution representation and fine-grained structure representation; Peakiness Fusion Attention Module can capture more salient features while fusing more spatial information to improve the performance of the network. The effectiveness of our dual-stream representation fusion learning is validated on different medical image segmentation tasks, and extensive experiments show that our DRFL outperforms the state-of-the-art methods in segmentation quality of lung nodule segmentation, lung segmentation, cell contour segmentation, and prostate segmentation. Our code is available at https://github.com/Rongtao-Xu/RepresentationLearning/tree/main/DRFL-EAAI2023. |
收录类别 | SCI |
WOS记录号 | WOS:000999560200001 |
七大方向——子方向分类 | 医学影像处理与分析 |
国重实验室规划方向分类 | 视觉信息处理 |
是否有论文关联数据集需要存交 | 否 |
引用统计 | |
文献类型 | 期刊论文 |
条目标识符 | http://ir.ia.ac.cn/handle/173211/51657 |
专题 | 多模态人工智能系统全国重点实验室_三维可视计算 多模态人工智能系统全国重点实验室 |
通讯作者 | Xu RT(许镕涛); Zhang XP(张晓鹏) |
作者单位 | 1.State Key Laboratory of Multimodal Artificial Intelligence Systems, Institute of Automation, China 2.School of Artificial Intelligence, Beijing University of Posts and Telecommunications, China 3.School of Artificial Intelligence, University of Chinese Academy of Sciences, China |
推荐引用方式 GB/T 7714 | Xu RT,Wang CW,Xu SB,et al. Dual-stream Representation Fusion Learning for accurate medical image segmentation[J]. Engineering Applications of Artificial Intelligence,2023,123:106402. |
APA | Xu RT,Wang CW,Xu SB,Meng WL,&Zhang XP.(2023).Dual-stream Representation Fusion Learning for accurate medical image segmentation.Engineering Applications of Artificial Intelligence,123,106402. |
MLA | Xu RT,et al."Dual-stream Representation Fusion Learning for accurate medical image segmentation".Engineering Applications of Artificial Intelligence 123(2023):106402. |
条目包含的文件 | 下载所有文件 | |||||
文件名称/大小 | 文献类型 | 版本类型 | 开放类型 | 使用许可 | ||
1-s2.0-S095219762300(1893KB) | 期刊论文 | 作者接受稿 | 开放获取 | CC BY-NC-SA | 浏览 下载 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论