Spatial-spectral fusion of GF-5/GF-1 remote sensing images based on multiresolution analysis

  • role: First author第一作者
  • Affiliation:

    Faculty of Electrical Engineering and Computer Science, Ningbo University, Ningbo 315211, China

  • Email:mengxiangchao@nbu.edu.cn
  • Introduction: 孟祥超,1989年生, 男, 讲师, 研究方向为遥感影像融合理论方法和应用。 E-mail:mengxiangchao@nbu.edu.cn
MENG Xiangchao1,  
  • role: Corresponding author通信作者
  • Affiliation:

    Department of Geography and Spatial Information Techniques, Ningbo University, Ningbo 315211, China

  • Email:sunweiwei@nbu.edu.cn
  • Introduction: 孙伟伟,1985年生, 男, 教授, 研究方向为地理信息系统理论和方法、高光谱遥感理论和海岸带监测技术。E-mail:sunweiwei@nbu.edu.cn
SUN Weiwei2*,  
  • Affiliation:

    Department of Geography and Spatial Information Techniques, Ningbo University, Ningbo 315211, China

REN Kai2,  
  • Affiliation:

    Department of Geography and Spatial Information Techniques, Ningbo University, Ningbo 315211, China

YANG Gang2,  
  • Affiliation:

    Faculty of Electrical Engineering and Computer Science, Ningbo University, Ningbo 315211, China

SHAO Feng1,  
  • Affiliation:

    Faculty of Electrical Engineering and Computer Science, Ningbo University, Ningbo 315211, China

FU Randi1

Resümee

This study proposed a multisensor image fusion solution for the GF-5/GF-1 spatial-spectral fusion with large spatial resolution ratio. We aimed to obtain the fused image through step-by-step fusion of multisensor remote sensing images. A unified fusion framework for multisensor image fusion was derived on the basis of step-by-step fusion theory. An integrated multisensor image fusion method based on multiresolution analysis theory was proposed in accordance with the unified framework. The proposed method can overcome the difficulty of integrating complementary high spatial and spectral information of multisource images under high spatial resolution ratio. In the proposed method, a modulation transfer function was applied to separate the spatial (high frequency) and spectral components (low frequency) of multisource images. The fusion weight was constructed by comprehensively considering the relationship between multisensor high spatial resolution images and high spectral resolution images and the relationship among the spectral bands of the high spectral resolution image. Fused images with the highest spatial and spectral resolutions can be obtained. The GF-1 panchromatic, GF-1 multispectral, and GF-5 hyperspectral images were used in the experiments. Experimental results show that the proposed multisensor spatial–spectral fusion can effectively integrate the complementary spatial and spectral information to obtain the comparative fused results.

Schlüsselwort

remote sensing;GF-5 satellite;spatial-spectral fusion;large spatial resolution difference;multi-sensor

References

  1. 1.
    Aiazzi B, Alparone L, Baronti S, Garzelli A and Selva M . 2006. MTF-tailored multiscale fusion of high-resolution MS and Pan imagery. Photogrammetric Engineering and Remote Sensing, 72(5): 591-596
  2. 2.
    Cetin M and Musaoglu N . 2009. Merging hyperspectral and panchromatic image data: qualitative and quantitative analysis. International Journal of Remote Sensing, 30(7): 1779-1804
  3. 3.
    Chavez Jr P S, Sides S C and Anderson J A . 1991. Comparison of three different methods to merge multiresolution and multispectral data: landsat TM and SPOT panchromatic. Photogrammetric Engineering and Remote Sensing, 57(3): 295-303
  4. 4.
    Huang W, Xiao L, Wei Z H, Liu H Y and Tang S Z . 2015. A new pan-Sharpening method with deep neural networks. IEEE Geoscience and Remote Sensing Letters, 12(5): 1037-1041
  5. 5.
    Laben C A and Brower B V . 2000. Process for enhancing the spatial resolution of multispectral imagery using pan-sharpening. U.S., No. 6011875
  6. 6.
    Liu Y N . 2018. Visible-shortwave infrared hyperspectral imager of GF-5 satellite. Spacecraft Recovery and Remote Sensing, 39(3): 25-28
  7. 7.
    Loncan L, De Almeida L B, Bioucas-Dias J M, Briottet X, Chanussot J, Dobigeon N, Fabre S, Liao W Z, Licciardi G A, Simões M, Tourneret J Y, Veganzones M A, Vivone G, Wei Q and Yokoya N . 2015. Hyperspectral pansharpening: a review. IEEE Geoscience and Remote Sensing Magazine, 3(3): 27-46
  8. 8.
    Meng X C, Shen H F, Zhang L P, Yuan Q Q and Li H F . 2015. A unified framework for spatio-temporal-spectral fusion of remote sensing images//Proceedings of 2015 IEEE International Geoscience and Remote Sensing Symposium (IGARSS). Milan, Italy: IEEE: 2584-2587 [DOI: 10.1109/IGARSS.2015.7326340]
  9. 9.
    Meng X C . 2017. The Variational Fusion Methods for Multisource Spatio-Temporal-Spectral Optical Remote Sensing Images. Wuhan: Wuhan University (孟祥超. 2017. 多源时—空—谱光学遥感影像的变分融合方法. 武汉: 武汉大学)
  10. 10.
    Meng X C, Shen H F, Li H F, Zhang L P and Fu R D . 2019. Review of the pansharpening methods for remote sensing images based on the idea of meta-analysis: practical discussion and challenges. Information Fusion, 46: 102-113
  11. 11.
    Meng X C, Shen H F, Yuan Q Q, Li H F, Zhang L P and Sun W W . 2019. Pansharpening for cloud-contaminated very high-resolution remote sensing images. IEEE Transactions on Geoscience and Remote Sensing, 57(5): 2840-2854
  12. 12.
    Otazu X, González-Audícana M, Fors O and Núñez J . 2005. Introduction of sensor spectral response into image fusion methods. Application to wavelet-based methods. IEEE Transactions on Geoscience and Remote Sensing, 43(10): 2376-2385
  13. 13.
    Shen H. 2012. Integrated fusion method for multiple temporal-spatial-spectral images//International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences. Melbourne, Australia: [s.n.]: 407-410 [DOI: 10.5194/isprsarchives-XXXIX-B7-407-2012]
  14. 14.
    Shen H F, Meng X C and Zhang L P . 2016. An integrated framework for the spatio-temporal-spectral fusion of remote sensing images. IEEE Transactions on Geoscience and Remote Sensing, 54(12): 7135-7148
  15. 15.
    Tu T M, Su S C, Shyu H C and Huang P S . 2001. A new look at IHS-like image fusion methods. Information Fusion, 2(3): 177-186
  16. 16.
    Vivone G, Alparone L, Chanussot J, Mura M D, Garzelli A, Licciardi G A, Restaino R and Wald L . 2015. A critical comparison among pansharpening algorithms. IEEE Transactions on Geoscience and Remote Sensing, 53(5): 2565-2586
  17. 17.
    Wald L. 2000. Quality of high resolution synthesised images: is there a simple criterion?//Proceedings of the 3rd Conference “Fusion of Earth Data: Merging Point Measurements, Raster Maps and Remotely Sensed Images”. Sophia Antipolis, France: [s.n.]: 99-103
  18. 18.
    Wang Z and Bovik A C . 2002. A universal image quality index. IEEE Signal Processing Letters, 9(3): 81-84
  19. 19.
    Xu J, Guan Z Q, He X F and Hu J W . 2009. Novel method for merging panchromatic and multi-spectral images based on sensor spectral response. Journal of Remote Sensing, 13(1): 97-102
  20. 20.
    Yokoya N, Yairi T and Iwasaki A . 2012. Coupled nonnegative matrix factorization unmixing for hyperspectral and multispectral data fusion. IEEE Transactions on Geoscience and Remote Sensing, 50(2): 528-537
  21. 21.
    Zhang L P and Shen H F . 2016. Progress and future of remote sensing data fusion. Journal of Remote Sensing, 20(5): 1050-1061
  22. 22.
    Zhu X X, Tuia D, Mou L C, Xia G S, Zhang L P, Xu F and Fraundorfer F . 2017. Deep learning in remote sensing: a comprehensive review and list of resources. IEEE Geoscience and Remote Sensing Magazine, 5(4): 8-36

Lesen Sie die ganze Passage

The above content is generated by Large Model Translation. The translated content is for reference only. We do not assume any commercial or legal responsibilty for any consequences arising from the use of our website