浏览全部资源
扫码关注微信
Published Online： 17 October 2024 ，
移动端阅览
孙习东，付波霖，李华剑，贾明明，孙伟伟，武炎，宋奕基.XXXX.基于CMIFM的跨平台超分辨率高光谱影像重建及光谱定量评估——以岩溶湿地为例.遥感学报，XX（XX）： 1-22
SUN Xidong，FU Bolin，LI Huajian，JIA Mingming，SUN Weiwei，WU yan，SONG Yiji. XXXX. Combination of CMIFM module and super-resolution network for cross-platform hyperspectral image reconstruction and spectral quantitative assessment——A case study of karst wetland. National Remote Sensing Bulletin， XX（XX）：1-22
高光谱遥感时序精准监测湿地植被和水体状况已成为准确评估和全面监测岩溶湿地生态系统状况的重要基础。然而，现有星载高光谱影像的空间分辨率较低，难以捕捉湿地植被复杂的空间细节，已有超分辨率重建方法无法实现卫星和无人机跨平台影像重建，且难以实现对大范围湿地场景的时序监测。为了解决上述问题，本文提出一种跨平台的多尺度影像特征映射模块CMIFM（Cross-Sensor Multiscale Image Feature Mapping Module）。该模块统一了无人机高光谱影像AHSI（Aerial hyperspectral image）和星载高光谱影像SHSI（Spaceborne hyperspectral image）的空间尺度，根据携式地物光谱仪ASD（Analytical Spectral Devices）的实测数据将AHSI和SHSI映射在同一个光谱特证空间中，进而整合AHSI和SHSI的空谱特征信息，构建影像特征数据集。通过使用超分辨率网络（ESRGAN和SwinIR）实现SHSI的高质量影像重建。同时，本文采用最新的深度学习（DATFuse）和传统的融合方法（GS），对比在湿地场景下，Sentinel-2和OHS-02重建影像和融合影像中植被群落和水体的光谱和空间质量。研究结果表明：（1）基于CMIFM的超分辨率网络能够通过学习AHSI特征，实现跨平台提升SHSI中湿地植被和水体的空间纹理细节信息，在视觉感知和定量指标方面均优于GS影像融合方法，重建影像的平均
PSNR
和
SSIM
精度分别为11.06和0.3102；（2）重建影像中狗牙根、华克拉莎和芒草3种典型湿地植被群落以及水体的光谱特征和实测ASD数据相比具有高稳定性和保真性，且光谱波段的平均
RMSE
和
R
2
精度值高于DATFuse和GS融合影像；（3）CMIFM+ESRGAN和CMIFM+SwinIR方法在空谱重建性能上具有较强的泛化能力，能够在AHSI未覆盖的区域中完成影像的重建，平均
PSNR
和
R
2
分别为12.74和0.1897，接近AHSI覆盖区域的精度数值范围。（4）本文验证了基于CMIFM模块的超分辨率技术在复杂湿地高光谱影像重建中的可行性。
Time-series accurate monitoring of vegetation and water conditions by hyperspectral remote sensing is the key and foundation for accurate assessment and comprehensive monitoring of karst wetland ecosystem. However
the spatial resolution of the existing satellite hyperspectral images is low
which could hardly capture the complex spatial details of the wetland vegetations
while the super-high-resolution UAV images could hardly realize the time-sequence monitoring of the large-scale wetland scenes. The existing fusion methods could not well realize the non-destructive fusion of the spatial and spectral features of the hyperspectral images from the above two kinds of platforms. In order to solve the problems
this paper propose a cross-pla
tform multi-scale image feature mapping module (Cross-Sensor Multiscale Image Feature Mapping Module
CMIFM). This module unifies the spatial scale of UAV hyperspectral image (Aerial hyperspectral image
AHSI) and satellite hyperspectral image (Spaceborne hyperspectral image
SHSI)
maps AHSI and SHSI into the same spectral characteristic space according to the measured ASD (Analytical Spectral Devices) data
integrates the spatial- and spectral- feature fusion data of AHSI and SHSI to construct the image feature datasets. The high-quality image reconstruction of SHSI could be achieved by training feature datasets into super-resolution networks (ESRGAN and SwinIR). Meanwhile
this study used the latest deep-learning (DATFuse) and traditional (GS) fusion methods to compare the spatial- and spectral- quality of vegetations and water between the reconstructed and fused images in wetland scenes. This study highlights that: (1) CMIFM-based super-resolution network could realize cross-platform enhancement of spatial characteristics of detail information for wetland vegetation and water in SHSI by learning AHSI features
which could outperform the GS image fusion method in visual perception and quantitative indexes
and the average
PSNR
and
SSIM
accuracies of the reconstructed images are 11.06 and 0.3102
respectively. (2) the spectral features of three typical wetland vegetation communities (
Cynodon-dactylon
Cladium chinense Nees
and
Miscanthus
) and wetland water in the reconstructed images exhibit higher stability and fidelity based on the measured ASD data
and the average
RMSE
and
R
2
accuracies of the spectral bands are higher than the DATFuse and GS fusion images. (3) the CMIFM+ESRGAN and CMIFM+SwinIR methods provide strong generalization ability in terms of spatial- and spectral- reconstruction performance
and could be able to complete the reconstruction of the image in wetland scenes
where AHSI is not covered
with the average
PSNR
and
R
2
of 12.74 and 0.1897
respectively
which are close to the range of accuracies’ values for the AHSI-covered area. (4) this paper verified the feasibility of CMIFM based super-resolution technology in hyperspectral reconstruction images of complex wetlands.
岩溶湿地CMIFM模块跨平台的超分辨率重建DATFuse高光谱影像植被和水体的空谱重建质量定量评估
karst wetlandCMIFM modulecross-platform super-resolution reconstructionDATFuse fusion algorithmhyperspectral imagesquantitative evaluation of spatial-spectral reconstruction quality
Aiazzi B, Baronti S, Lotti F, Selva M. 2009. A comparison between global and context-adaptive pansharpening of multispectral images. IEEE Geoscience and Remote Sensing Letters. 6(2): 302-306. [DOI: 10.1109/LGRS.2008.2012003http://dx.doi.org/10.1109/LGRS.2008.2012003]
Alparone L, Baronti S, Aiazzi B, Garzelli A. 2016. Spatial methods for multispectral pansharpening: Multiresolution analysis demystified. IEEE transactions on geoscience and remote sensing. 54(5): 2563-2576. [DOI: 10.1109/TGRS.2015.2503045http://dx.doi.org/10.1109/TGRS.2015.2503045]
Bendoumi M A, He M, Mei S. 2014. Hyperspectral image resolution enhancement using high-resolution multispectral image based on spectral unmixing. IEEE Transactions on Geoscience and Remote Sensing. 52(10): 6574-6583. [DOI: 10.1109/TGRS.2014.2298056http://dx.doi.org/10.1109/TGRS.2014.2298056]
Cai J T, Fu B L, Chen T X, Geng R F, Li Y, He H C, Fan D L, Deng T F. 2020. Inversion of phytochemical parameters of Huixian Karst wetland based on Sentinel-2 satellite multi-spectral data. Wetland Science. 18(06):693-705.
蔡江涛, 付波霖, 陈铁喜, 耿仁方, 李颖, 何宏昌, 范冬林, 邓腾芳. 2020. 基于Sentinel-2卫星多光谱数据的会仙喀斯特湿地植物理化参数反演研究. 湿地科学. 18(06):693-705. [DOI:10.13248/j.cnki.wetlandsci.2020.06.008http://dx.doi.org/10.13248/j.cnki.wetlandsci.2020.06.008]
Chen C, Xiong Z W, Tian X M, Zha Z J, Wu F. 2019. Camera lens super-resolution. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (pp. 1652-1660).
Daniel T J, Richendrfer J, Falta R, Murdoch L, Lin H, Darnault C J. 2023. Hydrogeologic and geomorphic processes in a karst landscape and seasonably-cold climate: Linking spatial distribution and morphometric dynamics of closed depressions to bedrock fractures in a wastewater spray irrigated agricultural and forest system located at the site of the Living Filter in Central Pennsylvania, United States. Agricultural Water Management. 279. 108170.[https://doi.org/10.1016/j.agwat.2023.108170https://doi.org/10.1016/j.agwat.2023.108170]
Fu B L, Li S Z, Lao Z N, Yuan B Y, Liang Y Y, He W, Sun W W, He H C. 2023b. Multi-sensor and multi-platform retrieval of water chlorophyll a concentration in karst wetlands using transfer learning frameworks with ASD, UAV, and Planet CubeSate reflectance data. Science of The Total Environment. 901: 165963. [https://doi.org/10.1016/j.scitotenv.2023.165963https://doi.org/10.1016/j.scitotenv.2023.165963]
Fu B L, Sun X D, Li Y Y, Lao Z N, Deng T F, He H C, Sun W W, Zhou G Q. 2023a. Combination of super-resolution reconstruction and SGA-Net for marsh vegetation mapping using multi-resolution multispectral and hyperspectral images. International Journal of Digital Earth. 16(1): 2724-2761. [https://doi.org/10.1080/17538947.2023.2234340https://doi.org/10.1080/17538947.2023.2234340]
Fu B L, Zuo P P, Liu M, Lan G W, He H C, Lao Z N, Zhang Y, Fan D L, Gao E T. 2022. Classifying vegetation communities karst wetland synergistic use of image fusion and object-based machine learning algorithm with Jilin-1 and UAV multispectral images. Ecological Indicators. 140, 108989. [https://doi.org/10.1016/j.ecolind.2022.108989https://doi.org/10.1016/j.ecolind.2022.108989]
Ghassemian H. 2016. A review of remote sensing image fusion methods. Information Fusion. 32: 75-89. [https://doi.org/10.1016/j.inffus.2016.03.003https://doi.org/10.1016/j.inffus.2016.03.003]
Gu J J, Lu H N, Zuo W M, Dong C. 2019. Blind super-resolution with iterative kernel correction. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (pp. 1604-1613).
Han Y, Ke Y H, Wang Z P, Liang D Y, Zhou D M. 2023. Classification of wetland landscape in the Yellow River Delta from the Ziyi-02D satellite hyperspectral data. National Remote Sensing Bulletin. 27(6):1387-1399.
韩月, 柯樱海, 王展鹏, 梁德印, 周德民. 2023. 资源一号02D卫星高光谱数据黄河三角洲湿地景观分类. 遥感学报. 27（6）：1387-1399. [DOI：10.11834/jrs.20211071http://dx.doi.org/10.11834/jrs.20211071]
Hore A, Ziou D. 2010. Image quality metrics: PSNR vs. SSIM. In 2010 20th international conference on pattern recognition (pp. 2366-2369). IEEE.
Lassalle G, Ferreira M P, La Rosa L E C, Scafutto R D P M, de Souza Filho C R. 2023. Advances in multi-and hyperspectral remote sensing of mangrove species: A synthesis and study case on airborne and multisource spaceborne imagery. ISPRS Journal of Photogrammetry and Remote Sensing. 195: 298-312. [https://doi.org/10.1016/j.isprsjprs.2022.12.003https://doi.org/10.1016/j.isprsjprs.2022.12.003]
Liang J Y, Cao J Z, Sun G L, Zhang K, Van Gool L, Timofte R. 2021. Swinir: Image restoration using swin transformer. In Proceedings of the IEEE/CVF international conference on computer vision (pp. 1833-1844).
Maeda S. 2020. Unpaired image super-resolution using pseudo-supervision. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (pp. 291-300).
Metternicht G. 2003. Vegetation indices derived from high-resolution airborne videography for precision crop management. International Journal of Remote Sensing, 24(14), 2855-2877. [https://doi.org/10.1080/01431160210163074https://doi.org/10.1080/01431160210163074]
Peng K F, Jiang W G, Hou P, Wu Z F, Ling Z Y, Wang X H, Niu Z G, Mao D H. 2023. Continental-scale wetland mapping: A novel algorithm for detailed wetland types classification based on time series Sentinel-1/2 images. Ecological Indicators, 148, 110113. [https://doi.org/10.1016/j.ecolind.2023.110113https://doi.org/10.1016/j.ecolind.2023.110113]
Pu R, Gong P, Yu Q. 2008. Comparative analysis of EO-1 ALI and Hyperion, and Landsat ETM+ data for mapping forest crown closure and leaf area index. Sensors, 8(6), 3744-3766. [https://doi.org/10.3390/s8063744https://doi.org/10.3390/s8063744]
Soh J W, Cho S, Cho N I. 2020. Meta-transfer learning for zero-shot super-resolution. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (pp. 3516-3525).
Sun W W, Liu W W, Wang Y S, Zhao R, Huang M Z, Wang Y, Yang G, Meng X C. 2023. Research progress and prospects of hyperspectral remote sensing in global wetlands from 2010 to 2022. National Remote Sensing Bulletin. 27(06):1281-1299.
孙伟伟, 刘围围, 王煜淼, 赵锐, 黄明珠, 王耀, 杨刚, 孟祥超. 2023. 2010年—2022年全球湿地高光谱遥感研究进展与展望. 遥感学报. 27(06):1281-1299.
Sun W W, Ren K, Meng X C, Yang G, Xiao C C, Peng J T, Huang J F. 2022. MLR-DBPFN: A multi-scale low rank deep back projection fusion network for anti-noise hyperspectral and multispectral image fusion. IEEE Transactions on Geoscience and Remote Sensing. 60: 1-14. [DOI: 10.1109/TGRS.2022.3146296http://dx.doi.org/10.1109/TGRS.2022.3146296]
Tang W, He F Z, Liu Y, Duan Y S, Si T Z. 2023. DATFuse: Infrared and visible image fusion via dual attention transformer. IEEE Transactions on Circuits and Systems for Video Technology. [DOI: 10.1109/TCSVT.2023.3234340http://dx.doi.org/10.1109/TCSVT.2023.3234340]
Waheed M, Haq S M, Arshad F, Bussmann R W, Ali H M, Siddiqui M H. 2023. Phyto-ecological distribution patterns and identification of alien invasive indicator species in relation to edaphic factors from semi-arid region. Ecological Indicators. 148. 110053. [https://doi.org/10.1016/j.ecolind.2023.110053https://doi.org/10.1016/j.ecolind.2023.110053]
Wang F M, Haung J F, Tang Y L, Wang X Z. 2007. New vegetation index and its application in estimating leaf area index of rice. Rice Science, 14(3), 195-203. [https://doi.org/10.1016/S1672-6308(07)60027-4https://doi.org/10.1016/S1672-6308(07)60027-4]
Wang P J, Bayram B, Sertel E. 2022. A comprehensive review on deep learning based remote sensing image super-resolution methods. Earth-Science Reviews. 104110. [https://doi.org/10.1016/j.earscirev.2022.104110https://doi.org/10.1016/j.earscirev.2022.104110]
Wang X T, Yu K, Wu S X, Gu J J, Liu Y H, Dong C, Qiao Y, Change Loy C. 2018. Esrgan: Enhanced super-resolution generative adversarial networks. In Proceedings of the European conference on computer vision (ECCV) workshops (pp. 0-0).
Xu T Y, Wang F M, Shi Z, Xie L L, Yao X P. 2023. Dynamic estimation of rice aboveground biomass based on spectral and spatial information extracted from hyperspectral remote sensing images at different combinations of growth stages. ISPRS Journal of Photogrammetry and Remote Sensing. 202: 169-183. [https://doi.org/10.1016/j.isprsjprs.2023.05.021https://doi.org/10.1016/j.isprsjprs.2023.05.021]
Yang C, Everitt J H, Bradford J M, Murden D. 2004. Airborne hyperspectral imagery and yield monitor data for mapping cotton yield variability. Precision Agriculture, 5(5), 445-461. [doi: 10.13031/2013.16111http://dx.doi.org/10.13031/2013.16111]
Yang W L, Fu B L, Li S Z, Lao Z N, Deng T F, He W, He H C, Chen Z K. 2023. Monitoring multi-water quality of internationally important karst wetland through deep learning, multi-sensor and multi-platform remote sensing images: A case study of Guilin, China. Ecological Indicators. 154. 110755. [https://doi.org/10.1016/j.ecolind.2023.110755https://doi.org/10.1016/j.ecolind.2023.110755]
Zhang H Y, Cisse M, Dauphin Y N, Lopez-Paz D. 2017. mixup: Beyond empirical risk minimization. arXiv preprint arXiv:1710.09412. [https://doi.org/10.48550/arXiv.1710.09412https://doi.org/10.48550/arXiv.1710.09412]
Zhang Z, Jiang W G, Peng K F, Wu Z F, Ling Z Y, Li Z. 2023. Assessment of the impact of wetland changes on carbon storage in coastal urban agglomerations from 1990 to 2035 in support of SDG15. 1. Science of The Total Environment, 877, 162824. [https://doi.org/10.1016/j.scitotenv.2023.162824https://doi.org/10.1016/j.scitotenv.2023.162824]
相关作者
相关机构
京公网安备11010802024621