سابِق|تال

Generalization ability of cloud detection network for satellite imagery based on DeepLabv3+

  • role： First author第一作者
  • Affiliation：

    State Key Laboratory of Earth Surface Processes and Resource Ecology, Faculty of Geographical Science, Beijing Normal University, Beijing 100875, China

    Beijing Engineering Research Center for Globe Land Remote Sensing Products, Faculty of Geographical Science, Beijing Normal University, Beijing 100875, China

  • Email：201921051193@mail.bnu.edu.cn
  • Introduction：彭龙康，1997年生，男，硕士研究生，研究方向为事遥感影像云检测。E-mail: 201921051193@mail.bnu.edu.cn
PENG Longkang12,  
  • Affiliation：

    State Key Laboratory of Earth Surface Processes and Resource Ecology, Faculty of Geographical Science, Beijing Normal University, Beijing 100875, China

    Beijing Engineering Research Center for Globe Land Remote Sensing Products, Faculty of Geographical Science, Beijing Normal University, Beijing 100875, China

LIU Licong12,  
  • role： Corresponding author通信作者
  • Affiliation：

    State Key Laboratory of Earth Surface Processes and Resource Ecology, Faculty of Geographical Science, Beijing Normal University, Beijing 100875, China

    Beijing Engineering Research Center for Globe Land Remote Sensing Products, Faculty of Geographical Science, Beijing Normal University, Beijing 100875, China

  • Email：chenxuehong@bnu.edu.cn
  • Introduction：陈学泓，1985年生，男，副教授，研究方向为遥感图像融合、土地覆盖监测。E-mail: chenxuehong@bnu.edu.cn
CHEN Xuehong12*,  
  • Affiliation：

    State Key Laboratory of Earth Surface Processes and Resource Ecology, Faculty of Geographical Science, Beijing Normal University, Beijing 100875, China

    Beijing Engineering Research Center for Globe Land Remote Sensing Products, Faculty of Geographical Science, Beijing Normal University, Beijing 100875, China

CHEN Jin12,  
  • Affiliation：

    State Key Laboratory of Earth Surface Processes and Resource Ecology, Faculty of Geographical Science, Beijing Normal University, Beijing 100875, China

    Beijing Engineering Research Center for Globe Land Remote Sensing Products, Faculty of Geographical Science, Beijing Normal University, Beijing 100875, China

CAO Xin12,  
  • Affiliation：

    State Key Laboratory of Earth Surface Processes and Resource Ecology, Faculty of Geographical Science, Beijing Normal University, Beijing 100875, China

    Beijing Engineering Research Center for Globe Land Remote Sensing Products, Faculty of Geographical Science, Beijing Normal University, Beijing 100875, China

QIU Yuean12

ملخص

Deep learning algorithms have been developed and applied in detecting clouds for satellite imagery in recent years. However, deep neural network models consist of thousands or millions of parameters, thus usually requiring large amounts of training data. Therefore, understanding the generalization ability of deep learning techniques is vital in their application to cloud detection of different types of satellite imagery. Taking DeepLabv3+, a typical deep semantic segmentation algorithm, as an example, this study explored the generalization ability of the algorithm on the cloud detection of satellite imagery with different landscapes, spatial resolutions, and spectral band combinations based on the cloud labeled dataset “L8 Biome.” The “L8 Biome” dataset consists of 96 typical Landsat 8 OLI images and the corresponding manual cloud mask, which has been widely used for evaluating the performance of cloud and cloud shadow detection methods. First, the cloud labeled dataset “L8 Biome” was used to generate different training and test samples with different landscapes, spatial resolutions, and band combinations. Then, the performance of DeepLabv3+ was evaluated based on different training and test sets and compared with that of the typical Function of Mask (Fmask) algorithm. Results show the following: (1) the DeepLabv3+ trained by a fully mixed training set (consisting of imagery captured over all landscapes) has higher overall cloud accuracy (92.81%) and stability (standard deviation 12.08%) than that trained by the training set of imagery captured over a single landscape and performed better than the Fmask algorithm with an overall cloud accuracy of 88.75% and stability of 17.34%, indicating that the training set of the deep learning algorithm should include images captured over various landscape types; (2) the DeepLabv3+ trained by “mixed-1” training sets, which were built by removing the images captured over a single landscape type (except of snow/ice) from the fully mixed training set, achieved comparable accuracies with that trained by a fully mixed training set, indicating that the available training set is diverse enough and has a good generalization ability on imagery captured over different landscapes; (3) the DeepLabv3+ trained by a fully mixed training set with a 30-m resolution achieved similar cloud detection accuracies on the satellite images with different spatial resolutions (i.e., 30, 60, 120, and 240 m), indicating that the trained DeepLabv3+ could be directly applied on satellite imagery with different spatial resolution, whereas the Fmask algorithm performed poorly on the images with coarse resolutions; (4) DeepLabv3+ could explore the effective information from different spectral bands for cloud detection, and more spectral band input can generally improve the overall cloud accuracy and stability of DeepLabv3+. Among all input bands, shortwave infrared bands are greatly helpful for distinguishing snow/ice from clouds, whereas the thermal infrared band marginally improves the cloud detection accuracy for DeepLabv3+. Results indicate that the DeepLabv3+ cloud detection network trained by the “L8 Biome” dataset can be applied to various types of satellite imagery and outperforms the Fmask algorithm.

مفهوم

deep learning;cloud detection;DeepLabv3+;generalization ability;landscape;spectral band combination;spatial resolution

References

  1. 1.
    Ball J E, Anderson D T and Chan C S. 2017. Comprehensive survey of deep learning in remote sensing: theories, tools, and challenges for the community. Journal of Applied Remote Sensing, 11(4): 042609
  2. 2.
    Chen L C, Papandreou G, Schroff F and Adam H. 2017. Rethinking atrous convolution for semantic image segmentation[EB/OL]. (2017-12-05).
  3. 3.
    Chen L C, Zhu Y K, Papandreou G, Schroff F and Adam H. 2018. Encoder-decoder with atrous separable convolution for semantic image segmentation//Proceedings of the 15th European Conference on Computer Vision. Munich, Germany: Springer: 833-851
  4. 4.
    Chen Q, Zheng L J, Li X J, Xu C B, Wu Y, Xie D H and Liu L. 2019. Water body extraction from high-resolution satellite remote sensing images based on deep learning. Geography and Geo-information Science, 35(4): 43-49
  5. 5.
    Chen S L, Chen X H, Chen J, Jia P F, Cao X and Liu C Y. 2016. An iterative haze optimized transformation for automatic cloud/haze detection of Landsat imagery. IEEE Transactions on Geoscience and Remote Sensing, 54(5): 2682-2694
  6. 6.
    Chen X D, Zhang X, Liu L Y and Wang X F. 2019. Enhanced multi-temporal cloud detection algorithm for optical remote sensing images. Journal of Remote Sensing, 23(2): 280-290
  7. 7.
    Foga S, Scaramuzza P L, Guo S, Zhu Z, Dilley Jr R D, Beckmann T, Schmidt G L, Dwyer J L, Joseph Hughes M and Laue B. 2017. Cloud detection algorithm comparison and validation for operational Landsat data products. Remote Sensing of Environment, 194: 379-390
  8. 8.
    Frantz D, Haß E, Uhl A, Stoffels J and Hill J. 2018. Improvement of the Fmask algorithm for Sentinel-2 images: separating clouds from bright surfaces based on parallax effects. Remote Sensing of Environment, 215: 471-481
  9. 9.
    Harshvardhan, Randall D A and Corsetti T G. 1989. Earth radiation budget and cloudiness simulations with a general circulation model. Journal of the Atmospheric Sciences, 46(13): 1922-1942
  10. 10.
    Hughes M J and Hayes D J. 2014. Automated detection of cloud and cloud shadow in single-date Landsat imagery using neural networks and spatial post-processing. Remote Sensing, 6(6): 4907-4926
  11. 11.
    Irish R R. 2000. Landsat 7 automatic cloud cover assessment//Proceedings of SPIE 4049, Algorithms for Multispectral, Hyperspectral, and Ultraspectral Imagery VI. Orlando, USA: SPIE: 348-355
  12. 12.
    Jedlovec G J, Haines S L and LaFontaine F J. 2008. Spatial and temporal varying thresholds for cloud detection in GOES imagery. IEEE Transactions on Geoscience and Remote Sensing, 46(6): 1705-1717
  13. 13.
    Jeppesen J H, Jacobsen R H, Inceoglu F and Toftegaard T S. 2019. A cloud detection algorithm for satellite imagery based on deep learning. Remote Sensing of Environment, 229: 247-259
  14. 14.
    Lee J, Weger R C, Sengupta S K and Welch R M. 1990. A neural network approach to cloud classification. IEEE Transactions on Geoscience and Remote Sensing, 28(5): 846-855
  15. 15.
    Li Z W, Shen H F, Cheng Q, Liu Y H, You S C and He Z Y. 2019. Deep learning based cloud detection for medium and high resolution remote sensing images of different sensors. ISPRS Journal of Photogrammetry and Remote Sensing, 150: 197-212
  16. 16.
    Li Z W, Shen H F, Li H F, Xia G S, Gamba P and Zhang L P. 2017. Multi-feature combined cloud and cloud shadow detection in GaoFen-1 wide field of view imagery. Remote Sensing of Environment, 191: 342-358
  17. 17.
    Lyu M M, Han L J, Tian S F, Zhou W Q, Li W F and Qian Y G. 2016. Cloud detection under varied surfaces and atmospheric conditions with MODIS imagery. Journal of Remote Sensing, 20(6): 1371-1380
  18. 18.
    Mateo-García G, Laparra V, López-Puigdollers D and Gómez-Chova L. 2020. Transferring deep learning models for cloud detection between Landsat-8 and Proba-V. ISPRS Journal of Photogrammetry and Remote Sensing, 160: 1-17
  19. 19.
    Papadomanolaki M, Vakalopoulou M, Zagoruyko S and Karantzalos K. 2016. Benchmarking deep learning frameworks for the classification of very high resolution satellite multispectral data. ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 3(7): 83-88
  20. 20.
    Prasad A K, Chai L, Singh R P and Kafatos M. 2006. Crop yield estimation model for Iowa using remote sensing and surface parameters. International Journal of Applied Earth Observation and Geoinformation, 8(1): 26-33
  21. 21.
    Qiu S, Zhu Z and He B B. 2019. Fmask 4.0: improved cloud and cloud shadow detection in Landsats 4-8 and Sentinel-2 imagery. Remote Sensing of Environment, 231: 111205
  22. 22.
    Roy D P, Ju J C, Kline K, Scaramuzza P L, Kovalskyy V, Hansen M, Loveland T R, Vermote E and Zhang C S. 2010. Web-enabled Landsat Data (WELD): landsat ETM+ composited mosaics of the conterminous United States. Remote Sensing of Environment, 114(1): 35-49
  23. 23.
    Saunders R W and Kriebel K T. 1988. An improved method for detecting clear sky and cloudy radiances from AVHRR data. International Journal of Remote Sensing, 9(1): 123-150
  24. 24.
    Schmidhuber J. 2015. Deep learning in neural networks: an overview. Neural Networks, 61: 85-117
  25. 25.
    Shan N, Zheng T Y and Wang Z S. 2009. High-speed and high-accuracy algorithm for cloud detection and its application. Journal of Remote Sensing, 13(6): 1138-1155
  26. 26.
    Shen H F, Li X H, Cheng Q, Zeng C, Yang G, Li H F and Zhang L P. 2015. Missing information reconstruction of remote sensing data: a technical review. IEEE Geoscience and Remote Sensing Magazine, 3(3): 61-85
  27. 27.
    Stowe L L, Davis P A and McClain E P. 1999. Scientific basis and initial evaluation of the CLAVR-1 global clear/cloud classification algorithm for the advanced very high resolution radiometer. Journal of Atmospheric and Oceanic Technology, 16(6): 656-681
  28. 28.
    Sun L, Yang X, Jia S F, Jia C, Wang Q, Liu X Y, Wei J and Zhou X Y. 2020. Satellite data cloud detection using deep learning supported by hyperspectral data. International Journal of Remote Sensing, 41(4): 1349-1371
  29. 29.
    Verbesselt J, Hyndman R, Newnham G and Culvenor D. 2010. Detecting trend and seasonal changes in satellite image time series. Remote Sensing of Environment 114(1): 106-115
  30. 30.
    Wang J Q, Li J S, Zhou H C and Zhang X. 2019. Typical element extraction method of remote sensing image based on Deeplabv3 + and CRF. Computer Engineering, 45(10): 260-265, 271
  31. 31.
    Yang W, Zhang J L, Xu Z Y and Hu K. 2019. Real-time DeepLabv3+ for pedestrian segmentation. Journal of Optical Technology, 86(9): 570-578
  32. 32.
    Zhang Y C, Rossow W B, Lacis A A, Oinas V and Mishchenko M I. 2004. Calculation of radiative fluxes from the surface to top of atmosphere based on ISCCP and other global data sets: refinements of the radiative transfer model and the input data. Journal of Geophysical Research, 109(D19): D19105
  33. 33.
    Zhu X L and Helmer E H. 2018a. An automatic method for screening clouds and cloud shadows in optical satellite image time series in cloudy regions. Remote Sensing of Environment, 214: 135-153
  34. 34.
    Zhu Z, Qiu S, He B B and Deng C B. 2018b. Cloud and cloud shadow detection for Landsat images: the fundamental basis for analyzing Landsat time series//Weng Q H, ed. Remote Sensing Time Series Image Processing. Boca Raton: CRC Press: 25-46
  35. 35.
    Zhu Z, Wang S X and Woodcock C E. 2015. Improvement and expansion of the Fmask algorithm: cloud, cloud shadow, and snow detection for Landsats 4-7, 8, and Sentinel 2 images. Remote Sensing of Environment, 159: 269-277
  36. 36.
    Zhu Z and Woodcock C E. 2012. Object-based cloud and cloud shadow detection in Landsat imagery. Remote Sensing of Environment, 118: 83-94
  37. 37.
    Zi Y, Xie F Y and Jiang Z G. 2018a. A cloud detection method for Landsat 8 images based on PCANet. Remote Sensing, 10(6): 877

قراءة النص الكامل

The above content is generated by Large Model Translation. The translated content is for reference only. We do not assume any commercial or legal responsibilty for any consequences arising from the use of our website