CASIA OpenIR  > 学术期刊  > IEEE/CAA Journal of Automatica Sinica
MAUN: Memory-Augmented Deep Unfolding Network for Hyperspectral Image Reconstruction
Qian Hu; Jiayi Ma; Yuan Gao; Junjun Jiang; Yixuan Yuan
Source PublicationIEEE/CAA Journal of Automatica Sinica
ISSN2329-9266
2024
Volume11Issue:5Pages:1139-1150
AbstractSpectral compressive imaging has emerged as a powerful technique to collect the 3D spectral information as 2D measurements. The algorithm for restoring the original 3D hyperspectral images HSIs from compressive measurements is pivotal in the imaging process. Early approaches painstakingly designed networks to directly map compressive measurements to HSIs, resulting in the lack of interpretability without exploiting the imaging priors. While some recent works have introduced the deep unfolding framework for explainable reconstruction, the performance of these methods is still limited by the weak information transmission between iterative stages. In this paper, we propose a Memory-Augmented deep Unfolding Network, termed MAUN, for explainable and accurate HSI reconstruction. Specifically, MAUN implements a novel CNN scheme to facilitate a better extrapolation step of the fast iterative shrinkage-thresholding algorithm, introducing an extra momentum incorporation step for each iteration to alleviate the information loss. Moreover, to exploit the high correlation of intermediate images from neighboring iterations, we customize a cross-stage transformer CSFormer as the deep denoiser to simultaneously capture self-similarity from both in-stage and cross-stage features, which is the first attempt to model the long-distance dependencies between iteration stages. Extensive experiments demonstrate that the proposed MAUN is superior to other state-of-the-art methods both visually and metrically. Our code is publicly available at https://github.com/HuQ1an/MAUN .
KeywordCompressive imaging deep unfolding network hyperspectral image
DOI10.1109/JAS.2024.124362
Citation statistics
Document Type期刊论文
Identifierhttp://ir.ia.ac.cn/handle/173211/55704
Collection学术期刊_IEEE/CAA Journal of Automatica Sinica
Recommended Citation
GB/T 7714
Qian Hu,Jiayi Ma,Yuan Gao,et al. MAUN: Memory-Augmented Deep Unfolding Network for Hyperspectral Image Reconstruction[J]. IEEE/CAA Journal of Automatica Sinica,2024,11(5):1139-1150.
APA Qian Hu,Jiayi Ma,Yuan Gao,Junjun Jiang,&Yixuan Yuan.(2024).MAUN: Memory-Augmented Deep Unfolding Network for Hyperspectral Image Reconstruction.IEEE/CAA Journal of Automatica Sinica,11(5),1139-1150.
MLA Qian Hu,et al."MAUN: Memory-Augmented Deep Unfolding Network for Hyperspectral Image Reconstruction".IEEE/CAA Journal of Automatica Sinica 11.5(2024):1139-1150.
Files in This Item: Download All
File Name/Size DocType Version Access License
JAS-2023-1319.pdf(10937KB)期刊论文出版稿开放获取CC BY-NC-SAView Download
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Qian Hu]'s Articles
[Jiayi Ma]'s Articles
[Yuan Gao]'s Articles
Baidu academic
Similar articles in Baidu academic
[Qian Hu]'s Articles
[Jiayi Ma]'s Articles
[Yuan Gao]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Qian Hu]'s Articles
[Jiayi Ma]'s Articles
[Yuan Gao]'s Articles
Terms of Use
No data!
Social Bookmark/Share
File name: JAS-2023-1319.pdf
Format: Adobe PDF
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.