Knowledge Commons of Institute of Automation,CAS
Sparse self-attention aggregation networks for neural sequence slice interpolation | |
Wang, Zejin1,2; Liu, Jing1,2; Chen, Xi1; Li, Guoqing1; Han, Hua1,3,4 | |
发表期刊 | BioData Mining |
ISSN | 1756-0381 |
2021-02-01 | |
卷号 | 14期号:1页码:19 |
摘要 | AbstractBackgroundMicroscopic imaging is a crucial technology for visualizing neural and tissue structures. Large-area defects inevitably occur during the imaging process of electron microscope (EM) serial slices, which lead to reduced registration and semantic segmentation, and affect the accuracy of 3D reconstruction. The continuity of biological tissue among serial EM images makes it possible to recover missing tissues utilizing inter-slice interpolation. However, large deformation, noise, and blur among EM images remain the task challenging. Existing flow-based and kernel-based methods have to perform frame interpolation on images with little noise and low blur. They also cannot effectively deal with large deformations on EM images.ResultsIn this paper, we propose a sparse self-attention aggregation network to synthesize pixels following the continuity of biological tissue. First, we develop an attention-aware layer for consecutive EM images interpolation that implicitly adopts global perceptual deformation. Second, we present an adaptive style-balance loss taking the style differences of serial EM images such as blur and noise into consideration. Guided by the attention-aware module, adaptively synthesizing each pixel aggregated from the global domain further improves the performance of pixel synthesis. Quantitative and qualitative experiments show that the proposed method is superior to the state-of-the-art approaches.ConclusionsThe proposed method can be considered as an effective strategy to model the relationship between each pixel and other pixels from the global domain. This approach improves the algorithm’s robustness to noise and large deformation, and can accurately predict the effective information of the missing region, which will greatly promote the data analysis of neurobiological research. |
关键词 | Slice interpolation Biological tissue recovery EM images Sparse self-attention network Adaptive style-balance loss |
DOI | 10.1186/s13040-021-00236-z |
收录类别 | SCI |
语种 | 英语 |
资助项目 | NSFC[61701497] ; Instrument function development innovation program of Chinese Academy of Sciences[E0S92308] ; Instrument function development innovation program of Chinese Academy of Sciences[282019000057] ; Strategic Priority Research Program of Chinese Academy of Science[XDB32030200] |
项目资助者 | NSFC ; Instrument function development innovation program of Chinese Academy of Sciences ; Strategic Priority Research Program of Chinese Academy of Science |
WOS研究方向 | Mathematical & Computational Biology |
WOS类目 | Mathematical & Computational Biology |
WOS记录号 | BMC:10.1186/s13040-021-00236-z |
出版者 | BioMed Central |
七大方向——子方向分类 | 医学影像处理与分析 |
国重实验室规划方向分类 | 视觉信息处理 |
是否有论文关联数据集需要存交 | 否 |
引用统计 | |
文献类型 | 期刊论文 |
条目标识符 | http://ir.ia.ac.cn/handle/173211/42243 |
专题 | 脑图谱与类脑智能实验室_微观重建与智能分析 |
通讯作者 | Li, Guoqing; Han, Hua |
作者单位 | 1.National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences 2.School of Artificial Intelligence, University of Chinese Academy of Sciences 3.Center for Excellence in Brain Science and Intelligence Technology Shanghai Institutes for Biological Sciences, Chinese Academy of Sciences 4.School of Future Technology, University of Chinese Academy of Sciences |
第一作者单位 | 模式识别国家重点实验室 |
通讯作者单位 | 模式识别国家重点实验室 |
推荐引用方式 GB/T 7714 | Wang, Zejin,Liu, Jing,Chen, Xi,et al. Sparse self-attention aggregation networks for neural sequence slice interpolation[J]. BioData Mining,2021,14(1):19. |
APA | Wang, Zejin,Liu, Jing,Chen, Xi,Li, Guoqing,&Han, Hua.(2021).Sparse self-attention aggregation networks for neural sequence slice interpolation.BioData Mining,14(1),19. |
MLA | Wang, Zejin,et al."Sparse self-attention aggregation networks for neural sequence slice interpolation".BioData Mining 14.1(2021):19. |
条目包含的文件 | ||||||
文件名称/大小 | 文献类型 | 版本类型 | 开放类型 | 使用许可 | ||
Wang_Sparse_self-att(5022KB) | 期刊论文 | 作者接受稿 | 开放获取 | CC BY-NC-SA | 浏览 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论