Précédent|Prochain

An enhanced unmixing model for spatiotemporal image fusion

  • role： First author第一作者
  • Affiliation：

    Institute of Space and Earth Information Science, The Chinese University of Hong Kong, Hong Kong 999077, China

    Department of Geography and Resource Management, The Chinese University of Hong Kong, Hong Kong 999077, China

    Shenzhen Research Institute, The Chinese University of Hong Kong, Shenzhen 51805, China

  • Email：bohuang@cuhk.edu.hk
  • Introduction：黄波，1968年生, 男, 教授, 研究方向为遥感影像融合, 深度学习, 时空数据模型, 人工智能。E-mail: bohuang@cuhk.edu.hk
HUANG Bo123,  
  • role： Corresponding author通信作者
  • Affiliation：

    Institute of Space and Earth Information Science, The Chinese University of Hong Kong, Hong Kong 999077, China

  • Email：xiaolujiang@link.cuhk.edu.hk
  • Introduction：姜晓璐，1992年生，女，博士研究生，研究方向为遥感影像融合算法及其应用。E-mail: xiaolujiang@link.cuhk.edu.hk
JIANG Xiaolu1*

résumé

Remote sensing images with high spatial and temporal resolutions are vital for the real-time and fine monitoring of land surface and atmospheric environment. However, a single satellite sensor has to tradeoff between the spatial and temporal resolutions due to technical and budget limitations. In recent years, numerous spatial and temporal image fusion models have been proposed to produce high-resolution images with low cost and remarkable effectiveness. Despite the varying levels of success in the accuracy of fused images and the efficiency of algorithms, challenges always remain on the recovery of spatial details along with the complex land cover changes. This study presented an enhanced unmixing model for spatial and temporal image fusion (EUSTFM) that accounts for phenological changes (e.g., vegetation growth) and shape (e.g., urban expansion) and non-shape land cover changes (e.g., crop rotation) on the land surface simultaneously. First, a change detection method was devised to identify the pixels with land cover change. The similar pixels of the detected pixels were then searched in the neighborhood to recompose the spectral reflectance on the prediction date. Thus, the real land cover class on the prediction date can be defined using the recomposed high-resolution image rather than directly using the classification result from a prior date. Subsequently, the spatial unmixing of pixels can be conducted on the prior and prediction dates to produce a medium-resolution image pair with accurate spatial details. Finally, the calculation of the similar pixels in the neighborhood was implemented for the final prediction of the fused images using all the original high and low-resolution image pair in the prior time, low-resolution image in the prediction time, and the produced medium-resolution image pair in the prior and prediction times. This study tested the algorithms with two actual Landsat-MODIS datasets: one dataset focusing on typical phenological changes in a complex landscape in Australia and the other dataset focusing on shape land cover changes in Shenzhen, China, to demonstrate the performance of the proposed EUSTFM for complex temporal changes on various landscapes. Comparisons with the popular spatiotemporal fusion models, including Spatial and Temporal Adaptive Reference Fusion Model (STARFM) and Flexible Spatiotemporal DAta Fusion (FSDAF), showed that EUSTFM can robustly achieve a better fusion accuracy for all the phenological, non-shape, and shape land cover changes. The fused results using STARFM and FSDAF showed significant differences between the green band and the two other bands for typical phenological changes on a complex landscape in Australia. By contrast, the fused images using EUSTFM showed consistently high accuracy in all the three bands. This finding revealed a better performance for the fusion of images with various spatial resolution gaps, including a factor of 8 in near-infrared and red bands and a factor of 16 in the green bands. The proposed EUSTFM shows great potential in facilitating the monitoring of complex and diverse land surface dynamics.

mots-clés

spatial and temporal fusion;remote sensing images;spatial unmixing of pixels;change detection;temporal resolution;spatial resolution

References

  1. 1.
    Busetto L, Meroni M and Colombo R. 2008. Combining medium and coarse spatial resolution satellite data to improve the estimation of sub-pixel NDVI time series. Remote Sensing of Environment, 112(1): 118-131
  2. 2.
    Chen X H, Li W T, Chen J, Rao Y H and Yamaguchi Y. 2014. A combination of TsHARP and thin plate spline interpolation for spatial sharpening of thermal imagery. Remote Sensing, 6(4): 2845-2863
  3. 3.
    Dowman I and Reuter H I. 2017. Global geospatial data from Earth observation: status and issues. International Journal of Digital Earth, 10(4): 328-341
  4. 4.
    Emelyanova I V, McVicar T R, Van Niel T G, Li L T and Van Dijk A I J M. 2013. Assessing the accuracy of blending Landsat-MODIS surface reflectances in two landscapes with contrasting spatial and temporal dynamics: a framework for algorithm selection. Remote Sensing of Environment, 133: 193-209
  5. 5.
    Gao F, Masek J, Schwaller M and Hall F. 2006. On the blending of the Landsat and MODIS surface reflectance: predicting daily Landsat surface reflectance. IEEE Transactions on Geoscience and Remote Sensing, 44(8): 2207-2218
  6. 6.
    Hilker T, Wulder M A, Coops N C, Linke J, McDermid G, Masek J G, Gao F and White J C. 2009. A new data fusion model for high spatial- and temporal-resolution mapping of forest disturbance based on Landsat and MODIS. Remote Sensing of Environment, 113(8): 1613-1627
  7. 7.
    Huang B and Song H H. 2012. Spatiotemporal reflectance fusion via sparse representation. IEEE Transactions on Geoscience and Remote Sensing, 50(10): 3707-3716
  8. 8.
    Huang B and Zhang H K. 2014. Spatio-temporal reflectance fusion via unmixing: accounting for both phenological and land-cover changes. International Journal of Remote Sensing, 35(16): 6213-6233
  9. 9.
    Huang B and Zhao Y Q. 2017. Research status and prospect of spatiotemporal fusion of multi-source satellite remote sensing imagery. Acta Geodaetica et Cartographica Sinica, 46(10): 1492-1499
  10. 10.
    Jayalakshmi T and Santhakumaran A. 2011. Statistical normalization and back propagation for classification. International Journal of Computer Theory and Engineering, 3(1): 89-93
  11. 11.
    Ju J C and Roy D P. 2008. The availability of cloud-free Landsat ETM+ data over the conterminous United States and globally. Remote Sensing of Environment, 112(3): 1196-1211
  12. 12.
    Li S M, Sun D L, Goldberg M and Stefanidis A. 2013. Derivation of 30-m-resolution water maps from TERRA/MODIS and SRTM. Remote Sensing of Environment, 134: 417-430
  13. 13.
    Liu M, Yang W, Zhu X L, Chen J, Chen X H, Yang L Q and Helmer E H. 2019. An Improved Flexible Spatiotemporal DAta Fusion (IFSDAF) method for producing high spatiotemporal resolution normalized difference vegetation index time series. Remote Sensing of Environment, 227: 74-89
  14. 14.
    Lv Z Y, Liu T F, Zhang P L, Benediktsson J A, Lei T and Zhang X K. 2019. Novel adaptive histogram trend similarity approach for land cover change detection by using bitemporal very-high-resolution remote sensing images. IEEE Transactions on Geoscience and Remote Sensing, 57(12): 9554-9574
  15. 15.
    Ma Y, Chen F, Liu J B, He Y, Duan J B and Li X P. 2016. An automatic procedure for early disaster change mapping based on optical remote sensing. Remote Sensing, 8(4): 272
  16. 16.
    Maselli F. 2001. Definition of spatially variable spectral endmembers by locally calibrated multivariate regression analyses. Remote Sensing of Environment, 75(1): 29-38
  17. 17.
    Saah D, Tenneson K, Matin M, Uddin K, Cutter P, Poortinga A, Nguyen Q H, Patterson M, Johnson G, Markert K, Flores A, Anderson E, Weigel A, Ellenberg W L, Bhargava R, Aekakkararungroj A, Bhandari B, Khanal N, Housman I W, Potapov P, Tyukavina A, Maus P, Ganz D, Clinton N and Chishtie F. 2019. Land cover mapping in data scarce environments: challenges and opportunities. Frontiers in Environmental Science, 7: 150
  18. 18.
    Shi C L, Wang X H, Zhang M, Liang X J, Niu L Z, Han H Q and Zhu X M. 2019. A comprehensive and automated fusion method: the enhanced flexible spatiotemporal DAta fusion model for monitoring dynamic changes of land surface. Applied Sciences, 9(18): 3693
  19. 19.
    Song H H and Huang B. 2013. Spatiotemporal satellite image fusion through one-pair image learning. IEEE Transactions on Geoscience and Remote Sensing, 51(4): 1883-1896
  20. 20.
    Walker J, De Beurs K and Wynne R H. 2015. Phenological response of an Arizona dryland forest to short-term climatic extremes. Remote Sensing, 7(8): 10832-10855
  21. 21.
    Wang J and Huang B. 2017. A rigorously-weighted spatiotemporal fusion model with uncertainty analysis. Remote Sensing, 9(10): 990
  22. 22.
    Wang Z, Bovik A C, Sheikh H R and Simoncelli E P. 2004. Image quality assessment: from error visibility to structural similarity. IEEE Transactions on Image Processing, 13(4): 600-612
  23. 23.
    Wu M Q, Niu Z, Wang C Y, Wu C Y and Wang L. 2012. Use of MODIS and Landsat time series data to generate high-resolution temporal synthetic Landsat data using a spatial and temporal reflectance fusion model. Journal of Applied Remote Sensing, 6(1): 063507
  24. 24.
    Xie D F, Zhang J S, Sun P J, Pan Y Z, Yun Y and Yuan Z M Q. 2016. Remote sensing data fusion by combining STARFM and downscaling mixed pixel algorithm. Journal of Remote Sensing, 20(1): 62-72
  25. 25.
    Zhang B H, Zhang L, Xie D, Yin X L, Liu C J and Liu G. 2016. Application of synthetic NDVI time series blended from Landsat and MODIS data for grassland biomass estimation. Remote Sensing, 8(1): 10
  26. 26.
    Zhang M Z, Zhu D H, Su W, Huang J X, Zhang X D and Liu Z. 2019. Harmonizing multi-source remote sensing images for summer corn growth monitoring. Remote Sensing, 11(11): 1266
  27. 27.
    Zhao Y Q, Huang B and Song H H. 2018. A robust adaptive spatial and temporal image fusion model for complex land surface changes. Remote Sensing of Environment, 208: 42-62
  28. 28.
    Zhu X L, Cai F Y, Tian J Q and Williams T K A. 2018. Spatiotemporal fusion of multisource remote sensing data: literature survey, taxonomy, principles, applications, and future directions. Remote Sensing, 10(4): 527
  29. 29.
    Zhu X L, Chen J, Gao F, Chen X H and Masek J G. 2010. An enhanced spatial and temporal adaptive reflectance fusion model for complex heterogeneous regions. Remote Sensing of Environment, 114(11): 2610-2623
  30. 30.
    Zhu X L, Helmer E H, Gao F, Liu D S, Chen J and Lefsky M A. 2016. A flexible spatiotemporal method for fusing satellite images with different resolutions. Remote Sensing of Environment, 172: 165-177
  31. 31.
    Zhukov B, Oertel D, Lanzl F and Reinhackel G. 1999. Unmixing-based multisensor multiresolution image fusion. IEEE Transactions on Geoscience and Remote Sensing, 37(3): 1212-1226

Lire l'article complet

The above content is generated by Large Model Translation. The translated content is for reference only. We do not assume any commercial or legal responsibilty for any consequences arising from the use of our website