CASIA OpenIR  > 精密感知与控制研究中心  > 人工智能与机器学习
Multi-scale deformable transformer for multi-contrast knee MRI super-resolution
Zou, Beiji1,2; Ji, Zexin1,2; Zhu, Chengzhang1,2,4; Dai, Yulan1,2; Zhang, Wensheng3; Kui, Xiaoyan1,2
Source PublicationBIOMEDICAL SIGNAL PROCESSING AND CONTROL
ISSN1746-8094
2023
Volume79Pages:11
Corresponding AuthorKui, Xiaoyan(xykui@csu.edu.cn)
AbstractBackground and objective: Magnetic resonance imaging can present the precise anatomic structure in clinical applications. Nevertheless, due to the limited scanning equipment cost, scanning time and so on, high -resolution knee MR images are difficult to obtain. So the super-resolution technique is developed to improve the image quality. Unfortunately, conventional CNN-based methods cannot explicitly learn the long-range dependencies in images and simply integrate the auxiliary contrast without considering the characteristics of medical images. To tackle this issue, our approach aims to adaptively capture and fuse the significant auxiliary information of the multi-contrast images to improve the knee magnetic resonance image quality.Methods: We propose a multi-scale deformable transformer network (MSDT) for multi-contrast knee magnetic resonance imaging super-resolution. First, we aggregate multi-scale patch embedding from the multi-contrast knee MR images to effectively preserve the local contextual details and global structure information. Then, the deformable transformer architecture is designed to learn the data-dependent sparse attention of the knee MR image, which can adaptively obtain the high-frequency foreground details according to the image content.Results: The proposed method is evaluated on the fastMRI dataset under 2x and 4x enlargements. Our MSDT achieves higher PSNR of 31.98 and SSIM of 0.713 at 2x upsampling factor and PSNR of 30.38 and SSIM of 0.615 at 4x upsampling factor. Moreover, our method can generate clear tissue structures and fine details.Conclusions: The experimental results show superior performance in comparison to the state-of-the-art super -resolution methods. This indicates that the MSDT can effectively reconstruct the high-quality knee MR images.
KeywordMagnetic resonance imaging Multi-contrast reconstruction Super-resolution Transformer Convolutional neural network
DOI10.1016/j.bspc.2022.104154
WOS KeywordIMAGE SUPERRESOLUTION ; ALGORITHM ; NETWORK
Indexed BySCI
Language英语
Funding ProjectNational Key R&D Program of China[2018AAA0102100] ; National Natural Science Foundation of China[62177047] ; Key Research and Development Program of Hunan Province[2022SK2054] ; Scientific and Technological Innovation Leading Plan of High-tech Industry of Hunan Province[2020GK2021] ; Interna-tional Science and Technology Innovation Joint Base of Machine Vision and Medical Image Processing in Hunan Province[2021CB1013] ; Natural Science Foundation of Hunan Province[2022JJ30762] ; 111 project[B18059]
Funding OrganizationNational Key R&D Program of China ; National Natural Science Foundation of China ; Key Research and Development Program of Hunan Province ; Scientific and Technological Innovation Leading Plan of High-tech Industry of Hunan Province ; Interna-tional Science and Technology Innovation Joint Base of Machine Vision and Medical Image Processing in Hunan Province ; Natural Science Foundation of Hunan Province ; 111 project
WOS Research AreaEngineering
WOS SubjectEngineering, Biomedical
WOS IDWOS:000862722500008
PublisherELSEVIER SCI LTD
Citation statistics
Document Type期刊论文
Identifierhttp://ir.ia.ac.cn/handle/173211/50414
Collection精密感知与控制研究中心_人工智能与机器学习
Corresponding AuthorKui, Xiaoyan
Affiliation1.Cent South Univ, Sch Comp Sci & Engn, Changsha 410083, Peoples R China
2.Cent South Univ, Hunan Engn Res Ctr Machine Vis & Intelligent Med, Changsha 410083, Peoples R China
3.Chinese Acad Sci, Inst Automat, Beijing 100190, Peoples R China
4.Cent South Univ, Coll Literature & Journalism, Changsha 410083, Peoples R China
Recommended Citation
GB/T 7714
Zou, Beiji,Ji, Zexin,Zhu, Chengzhang,et al. Multi-scale deformable transformer for multi-contrast knee MRI super-resolution[J]. BIOMEDICAL SIGNAL PROCESSING AND CONTROL,2023,79:11.
APA Zou, Beiji,Ji, Zexin,Zhu, Chengzhang,Dai, Yulan,Zhang, Wensheng,&Kui, Xiaoyan.(2023).Multi-scale deformable transformer for multi-contrast knee MRI super-resolution.BIOMEDICAL SIGNAL PROCESSING AND CONTROL,79,11.
MLA Zou, Beiji,et al."Multi-scale deformable transformer for multi-contrast knee MRI super-resolution".BIOMEDICAL SIGNAL PROCESSING AND CONTROL 79(2023):11.
Files in This Item:
There are no files associated with this item.
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Zou, Beiji]'s Articles
[Ji, Zexin]'s Articles
[Zhu, Chengzhang]'s Articles
Baidu academic
Similar articles in Baidu academic
[Zou, Beiji]'s Articles
[Ji, Zexin]'s Articles
[Zhu, Chengzhang]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Zou, Beiji]'s Articles
[Ji, Zexin]'s Articles
[Zhu, Chengzhang]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.