سابِق|تال

Spatio-temporal fusion quality evaluation based on “Point”-“Line”-“Plane” aspects

  • role： First author第一作者
  • Affiliation：

    Faculty of Electrical Engineering and Computer Science, Ningbo University, Ningbo 315211, China

  • Introduction：雷晨阳，1995年生，女，硕士研究生，研究方向遥感数据时—空融合的研究应用。E-mail: sketchlcy@126.com
LEI Chenyang1,  
  • role： Corresponding author通信作者
  • Affiliation：

    Faculty of Electrical Engineering and Computer Science, Ningbo University, Ningbo 315211, China

    College of Electrical and Information Engineering, Hunan University, Changsha 410082, China

  • Email：mengxiangchao@nbu.edu.cn
  • Introduction：孟祥超，1989年生，男，讲师，研究方向为多源遥感数据融合与应用。E-mail: mengxiangchao@nbu.edu.cn
MENG Xiangchao12*,  
  • Affiliation：

    Faculty of Electrical Engineering and Computer Science, Ningbo University, Ningbo 315211, China

SHAO Feng1

ملخص

Remote sensing images with both high spatial and high temporal resolutions are highly desirable in various applications. However, due to technical limitations of remote sensing imaging system and other factors, the acquired remote sensing images have to make a fundamental trade-off between high spatial and temporal resolutions. For example, the MODIS images have high temporal resolution, its spatial resolution is low; On the contrary, the Landsat images have high spatial resolution with relatively lower temporal resolution.Spatio-temporal fusion can integrate the complementary advantages of high spatial resolution and high spectral resolution, respectively, of multi-source remote sensing images, to generate time-continuous images with high spatial resolution. This has important application value in remote sensing image dynamic monitoring, time-series analysis, and other aspects. To the best of our knowledge, at present, most of studies generally evaluated the spatio-temporal fused images based on a single type of remote sensing data, such as the surface reflectance data or the Normalized Difference Vegetation Index (NDVI) remote sensing product, etc. However, how well a spatio-temporal fusion method performs in practical applications? This should be comprehensively assessed from different aspects based on different types of remote sensing data products. In addition, most of studies performed the evaluation of a spatio-temporal fusion method based on the fused image at a single phase. However, for spatio-temporal fusion, the final target is actually to obtain time-series fused images, the quality evaluation of the fused images from the temporal dimension should be also taken into account. Whereas, to the best of our knowledge, the quality evaluation for time-series fused images is not comprehensively considered in the existing studies. In this paper, we proposed to evaluate the spatio-temporal fusion methods from the comprehensive perspective of single time point, time series, and multiple different remote sensing data products. In this paper, spatio-temporal fusion data sets, including surface reflectance data set, NDVI data set, and the Land Surface Temperature (LST) data set were established based on Landsat and MODIS remote sensing satellite images. In addition, some typical spatio-temporal fusion methods were reviewed, and the performance of four spatio-temporal fusion algorithms, including the Spatial and Temporal Adaptive Reflectance Fusion Model (STARFM), Enhanced STARFM (ESTARFM), Flexible Spatio-Temporal Data Fusion (FSDAF), and the Spatial and Temporal Nonlocal Filter-based Fusion Model (STNLFFM), were qualitatively and quantitatively evaluated based on the proposed data sets of different kinds of remote sensing data products, i.e., the surface reflectance, NDVI, and LST. In addition, the quality evaluation from the perspective of both single-time-point and time-series dimensions were performed. The experimental results show that the performance of spatio-temporal fusion algorithms can be more comprehensively verified based on different type of data sets, and the evaluation combined with single time point and time-series data set is more objective.

مفهوم

spatio-temporal fusion;reflectance;Normalized Difference Vegetation Index(NDVI);Land Surface Temperature(LST);quality evaluation

References

  1. 1.
    Ball G H and Hall D J. 1965. ISODATA, A Novel Method of Data Analysis and Pattern Classification. Menlo Park: Stanford Research Institute
  2. 2.
    Buades A, Coll B and Morel J M. 2005a. A non-local algorithm for image denoising//Proceedings of 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. San Diego: IEEE
  3. 3.
    Buades A, Coll B and Morel J M. 2005b. A review of image denoising algorithms, with a new one. Multiscale Modeling and Simulation, 4(2): 490-530
  4. 4.
    Chen B, Huang B and Xu B. 2015. Comparison of spatiotemporal fusion models: a review. Remote Sensing, 7(2): 1798-1835
  5. 5.
    Cheng Q, Liu H Q, Shen H F, Wu P H and Zhang L P. 2017. A spatial and temporal nonlocal filter-based data fusion method. IEEE Transactions on Geoscience and Remote Sensing, 55(8): 4476-4488
  6. 6.
    Dennison P E, Halligan K Q and Roberts D A. 2004. A comparison of error metrics and constraints for multiple endmember spectral mixture analysis and spectral angle mapper. Remote Sensing of Environment, 93(3): 359-367
  7. 7.
    Dubrule O. 1984. Comparing splines and kriging. Computers and Geosciences, 10(2/3): 327-338
  8. 8.
    Gao F, Masek J, Schwaller M and Hall F. 2006. On the blending of the Landsat and MODIS surface reflectance: predicting daily Landsat surface reflectance. IEEE Transactions on Geoscience and Remote Sensing, 44(8): 2207-2218
  9. 9.
    Gevaert C M and García-Haro F J. 2015. A comparison of STARFM and an unmixing-based algorithm for Landsat and MODIS data fusion. Remote Sensing of Environment, 156: 34-44
  10. 10.
    Hazaymeh K and Almagbile A. 2018. A comparative analysis of spatiotemporal data fusion models for Landsat and modis data. International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, XLII-3: 491-495
  11. 11.
    Huang B and Song H H. 2012. Spatiotemporal reflectance fusion via sparse representation. IEEE Transactions on Geoscience and Remote Sensing, 50(10): 3707-3716
  12. 12.
    Khan M M, Alparone L and Chanussot J. 2009. Pansharpening quality assessment using the modulation transfer functions of instruments. IEEE Transactions on Geoscience and Remote Sensing, 47(11): 3880-3891
  13. 13.
    Li L, Wang X Q and Li M M. 2011. Study on the fusion of MODIS and TM images using the spectral response Function and STARFM algorithm//Proceedings of 2011 International Conference on Image Analysis and Signal Processing. Hubei: IEEE: 171-176
  14. 14.
    Maselli F, Chiesi M and Pieri M. 2019. A new method to enhance the spatial features of multitemporal NDVI image series. IEEE Transactions on Geoscience and Remote Sensing, 57(7): 4967-4979
  15. 15.
    Meng X C, Sun W W, Ren K, Yang G, Fu R D. 2020. Spatial-spectral fusion of GF-5/GF-1 remote sensing images based on multiresolution analysis. Journal of Remote Sensing. 24(04):379-387
  16. 16.
    Qin Z, Karnieli A and Berliner P. 2001. A mono-window algorithm for retrieving land surface temperature from Landsat TM data and its application to the Israel-Egypt border region. International Journal of Remote Sensing, 22(18): 3719-3746
  17. 17.
    Quan J L. 2017. Blending multi-spatiotemporal resolution land surface temperatures over heterogeneous surfaces//Proceedings of 2017 Joint Urban Remote Sensing Event. Dubai: IEEE
  18. 18.
    Shen H F, Meng X C and Zhang L P. 2016. An integrated framework for the spatio-temporal-spectral fusion of remote sensing images. IEEE Transactions on Geoscience and Remote Sensing, 54(12): 7135-7148
  19. 19.
    Su X, Deledalle C A, Tupin F and Sun H. 2012. Two steps multi-temporal non-local means for SAR images//Proceedings of 2012 IEEE International Geoscience and Remote Sensing Symposium. Munich: IEEE
  20. 20.
    Wang Z, Bovik A C, Sheikh H R and Simoncelli E P. 2004. Image quality assessment: from error visibility to structural similarity. IEEE Transactions on Image Processing, 13(4): 600-612
  21. 21.
    Yang M, Yang G J, Chen X N, Zhang Y F and You J N. 2018. Generation of land surface temperature with high spatial and temporal resolution based on FSDAF method. Remote Sensing for Land and Resources, 30(1): 54-62
  22. 22.
    Zhang H K, Huang B, Zhang M, Cao K and Yu L. 2015. A generalization of spatial and temporal fusion methods for remotely sensed surface parameters. International Journal of Remote Sensing, 36(17): 4411-4445
  23. 23.
    Zhu X L, Chen J, Gao F, Chen X H and Masek J G. 2010. An enhanced spatial and temporal adaptive reflectance fusion model for complex heterogeneous regions. Remote Sensing of Environment, 114(11): 2610-2623
  24. 24.
    Zhu X L, Helmer E H, Gao F, Liu D S, Chen J and Lefsky M A. 2016. A flexible spatiotemporal method for fusing satellite images with different resolutions. Remote Sensing of Environment, 172: 165-177

قراءة النص الكامل

The above content is generated by Large Model Translation. The translated content is for reference only. We do not assume any commercial or legal responsibilty for any consequences arising from the use of our website