Comparison of fusion methods on GF-5 hyperspectral data

  • role: First author第一作者
  • Affiliation:

    National Engineering Laboratory for Remote Sensing Satellite Applications, Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100101, China

  • Email:zhanglf@radi.ac.cn
  • Introduction:E-mailzhanglf@radi.ac.cn
ZHANG Lifu1,  
  • Affiliation:

    National Engineering Laboratory for Remote Sensing Satellite Applications, Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100101, China

    University of Chinese Academy of Sciences, Beijing 100049, China

ZHAO Xiaoyang12,  
  • role: Corresponding author通信作者
  • Affiliation:

    National Engineering Laboratory for Remote Sensing Satellite Applications, Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100101, China

  • Email:sunxj@radi.ac.cn
  • Introduction:E-mailsunxj@radi.ac.cn
SUN Xuejian1*,  
  • Affiliation:

    Key Laboratory of Lunar and Deep Space Exploration, Chinese Academy of Sciences, Beijing 100012, China

    National Astronomical Observatories, Chinese Academy of Sciences, Beijing 100012, China

    University of Chinese Academy of Sciences, Beijing 100049, China

HUANG Hai342,  
  • Affiliation:

    National Engineering Laboratory for Remote Sensing Satellite Applications, Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100101, China

    University of Chinese Academy of Sciences, Beijing 100049, China

PENG Mingyuan12,  
  • Affiliation:

    National Engineering Laboratory for Remote Sensing Satellite Applications, Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100101, China

CEN Yi1,  
  • Affiliation:

    Twenty First Century Aerospace Technology Co., Ltd., Beijing 100096, China

TU Kuan5

resumen

Data fusion is an effective way to solve the limitation of hyperspectral satellites on temporal and spatial resolution. Discussing the fusion effects of different methods on GF-5 hyperspectral data is highly important for information mining and promotion application of GF-5 hyperspectral data.In this study, based on the principle that the algorithm is easy to use and suitable for generalization, six fusion methods, namely, GS (Gram-Schmidt), GSA (GS Adaptive), CNMF (Coupled Non-negative Matrix Factorization), CRISP-B, CRISP-W (Color Resolution Improvement Software Package with Butterworth or Wavelet transform), GLP (Generalized Laplacian Pyramid) are separately used to perform fusion experiments on GF-5 hyperspectral data and multispectral data from BJ-2, GF-2, and GF-1/1C/1D domestic satellites. Visual interpretation, five indicators (correlation coefficient, universal image quality index, spectral angle mapper, erreur relative globale adimensionnelle de synthèse, and peak signal-to-noise ratio), classification application, and time costs are used to comprehensively evaluate the fusion results.Results show that the fusion image series are the same and the smaller the spatial resolution difference, the better the fusion result. CRISP-B, CRISP-W, and GLP can achieve a good balance in improving spatial resolution and spectral fidelity. In terms of spatial reconstruction, GLP is slightly better and more stable, while CRISP-B and CRISP-W are more stable and effective in maintaining spectral information. The data source will have a certain effect on the fusion method. In the tasks that require high spectral fidelity, such as spectral feature information extraction and analysis, GLP is more suitable for the fusion of homologous data (such as GF-5 and GF-1/1C/1D/2). When the multi-source images (GF-5 and BJ-2) are merged, CRISP-W is preferred. CNMF has a certain degree of color distortion and takes a long time to run. GSA and GS have the worst fusion effect. The spectral retention and the spatial resolution improvement ability of GSA are more stable than those of GS. Based on a small sample, the classification effect of the CRISP-B fusion result is stable and highly accurate. The GSA fusion results are rich in spatial details. Although the spectral distortion is relatively serious, it also increases the spectral distinction of the ground objects, which is still suitable for accurately drawing buildings and roads.This study provides method decision support for the fusion of GF-5 hyperspectral data and other domestic satellite multispectral data, which is helpful for the application and promotion of GF-5 hyperspectral data.

palabra clave

hyperspectral remote sensing;GF-5;domestic satellite;data fusion;fusion method evaluation

References

  1. 1.
    Aiazzi B, Baronti S and Selva M. 2007. Improving component substitution pansharpening through multivariate regression of MS + Pan data. IEEE Transactions on Geoscience and Remote Sensing, 45(10): 3230-3239
  2. 2.
    Alparone L, Wald L, Chanussot J, Thomas C, Gamba P and Bruce L M. 2007. Comparison of pansharpening algorithms: outcome of the 2006 GRS-S data-fusion contest. IEEE Transactions on Geoscience and Remote Sensing, 45(10): 3012-3021
  3. 3.
    Ghassemian H. 2016. A review of remote sensing image fusion methods. Information Fusion, 32: 75-89
  4. 4.
    Gomez R B, Jazaeri A and Kafatos M. 2001. Wavelet-based hyperspectral and multispectral image fusion//Proceedings of SPIE 4383, Geo-Spatial Image and Data Exploitation II. Orlando, FL, United States: SPIE: 36-42
  5. 5.
    Huynh-Thu Q and Ghanbari M. 2008. Scope of validity of PSNR in image/video quality assessment. Electronics Letters, 44(13): 800-801
  6. 6.
    Laben C A and Brower B V. 2000. Process for enhancing the spatial resolution of multispectral imagery using pan-sharpening. U.S., 6011875
  7. 7.
    Li D, Hao M F, Zhang J Q, Hu B and Lu Q Y. 2012. A universal hypercomplex color image quality index//Proceedings of 2012 IEEE International Instrumentation and Measurement Technology Conference. Graz, Austria: IEEE: 985-990
  8. 8.
    Li X T, Lu J X, Song X N, Sun Y Y, Li L, Lei T J and Qu W. 2018. Application of the GF satellite data in flood disaster monitoring//Proceedings of 2018 IEEE International Geoscience and Remote Sensing Symposium. Valencia, Spain: IEEE: 7293-7296
  9. 9.
    Liu Y N. 2018. Visible-shortwave infrared hyperspectral imager of GF-5 satellite. Spacecraft Recovery and Remote Sensing, 39(3): 25-28
  10. 10.
    Ren K, Sun W W, Meng X C, Yang G and Du Q. 2020. Fusing China GF-5 hyperspectral data with GF-1, GF-2 and sentinel-2A multispectral data: which methods should be used? Remote Sensing, 12(5): 882
  11. 11.
    Schmitt M and Zhu X X. 2016. Data fusion and remote sensing: an ever-growing relationship. IEEE Geoscience and Remote Sensing Magazine, 4(4): 6-23
  12. 12.
    Sun X J, Zhang L F, Yang H, Wu T X, Cen Y and Guo Y. 2015. Enhancement of spectral resolution for remotely sensed multispectral image. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 8(5): 2198-2211
  13. 13.
    Sun Y Z, Jiang G W, Li Y D, Yang Y, Dai H S, He J, Ye Q H, Cao Q, Dong C Z, Zhao S H and Wang W H. 2018. GF-5 Satellite: overview and application prospects. Spacecraft Recovery and Remote Sensing, 39(3): 1-13
  14. 14.
    Tong Q X, Xue Y Q and Zhang L F. 2014. Progress in hyperspectral remote sensing science and technology in China over the past three decades. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 7(1): 70-91
  15. 15.
    Wald L. 2000. Quality of high resolution synthesised images: is there a simple criterion?//Proceedings of the 3rd Conference “Fusion of Earth Data: Merging Point Measurements, Raster Maps and Remotely Sensed Images”. Sophia Antipolis: Thierry Ranchin, Lucien Wald Editors: 99-103
  16. 16.
    Wang Z and Bovik A C. 2002. A universal image quality index. IEEE Signal Processing Letters, 9(3): 81-84
  17. 17.
    Winter M E, Winter E M, Beaven S G and Ratkowski A J. 2007. Hyperspectral image sharpening using multispectral data//Proceedings of 2007 IEEE Aerospace Conference. Big Sky, MT: IEEE: 1-9
  18. 18.
    Yokoya N, Yairi T and Iwasaki A. 2012. Coupled nonnegative matrix factorization unmixing for hyperspectral and multispectral data fusion. IEEE Transactions on Geoscience and Remote Sensing, 50(2): 528-537
  19. 19.
    Yokoya N, Grohnfeldt C and Chanussot J. 2017. Hyperspectral and multispectral data fusion: a comparative review of the recent literature. IEEE Geoscience and Remote Sensing Magazine, 5(2): 29-56
  20. 20.
    Yuan Q Q, Wei Y C, Meng X C, Shen H F and Zhang L P. 2018. A multiscale and multidepth convolutional neural network for remote sensing imagery pan-sharpening. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 11(3): 978-989
  21. 21.
    Yuhas R H, Goetz A F H and Boardman J W. 1992. Discrimination among semi-arid landscape endmembers using the Spectral Angle Mapper (SAM) algorithm. Proceedings of the 1992 Summaries of the Third Annual JPL Airborne Geoscience Workshop. Pasadena: JPL, 1992: 147-149.
  22. 22.
    Zhang L F, Peng M Y, Sun X J, Cen Y and Tong Q X. 2019. Progress and bibliometric analysis of remote sensing data fusion methods (1992—2018). Journal of Remote Sensing, 23(4): 603-619
  23. 23.
    Zhang Y F, De Backer S and Scheunders P. 2009. Noise-resistant wavelet-based bayesian fusion of multispectral and hyperspectral images. IEEE Transactions on Geoscience and Remote Sensing, 47(11): 3834-3843
  24. 24.
    Zurita-Milla R, Clevers J G P W and Schaepman M E. 2008. Unmixing-based Landsat TM and MERIS FR data fusion. IEEE Geoscience and Remote Sensing Letters, 5(3): 453-457

Leer el texto completo

The above content is generated by Large Model Translation. The translated content is for reference only. We do not assume any commercial or legal responsibilty for any consequences arising from the use of our website