سابِق|تال

Applicability of weak samples to deep learning crop classification

  • role： First author第一作者
  • Affiliation：

    State Key Laboratory of Remote Sensing Science, Beijing Normal University, Beijing 100875, China

    Beijing Engineering Research Center for Global Land Remote Sensing Products, Faculty of Geographical Science, Beijing Normal University, Beijing 100875, China

    Institute of Remote Sensing Science and Engineering, Faculty of Geographical Science, Beijing Normal University, Beijing 100875, China

  • Email：201821051191@mail.bnu.edu.cn
  • Introduction：许晴，研究方向为农业遥感。E-mail： 201821051191@mail.bnu.edu.cn
XU Qing,  
  • role： Corresponding author通信作者
  • Affiliation：

    State Key Laboratory of Remote Sensing Science, Beijing Normal University, Beijing 100875, China

    Beijing Engineering Research Center for Global Land Remote Sensing Products, Faculty of Geographical Science, Beijing Normal University, Beijing 100875, China

    Institute of Remote Sensing Science and Engineering, Faculty of Geographical Science, Beijing Normal University, Beijing 100875, China

  • Email：zhangjs@bnu.edu.cn
  • Introduction：张锦水，研究方向为农业遥感。E-mail： zhangjs@bnu.edu.cn
ZHANG Jinshui*,  
  • Affiliation：

    State Key Laboratory of Remote Sensing Science, Beijing Normal University, Beijing 100875, China

    Beijing Engineering Research Center for Global Land Remote Sensing Products, Faculty of Geographical Science, Beijing Normal University, Beijing 100875, China

    Institute of Remote Sensing Science and Engineering, Faculty of Geographical Science, Beijing Normal University, Beijing 100875, China

ZHANG Feng,  
  • Affiliation：

    State Key Laboratory of Remote Sensing Science, Beijing Normal University, Beijing 100875, China

    Beijing Engineering Research Center for Global Land Remote Sensing Products, Faculty of Geographical Science, Beijing Normal University, Beijing 100875, China

    Institute of Remote Sensing Science and Engineering, Faculty of Geographical Science, Beijing Normal University, Beijing 100875, China

GE Shuang,  
  • Affiliation：

    State Key Laboratory of Remote Sensing Science, Beijing Normal University, Beijing 100875, China

    Beijing Engineering Research Center for Global Land Remote Sensing Products, Faculty of Geographical Science, Beijing Normal University, Beijing 100875, China

    Institute of Remote Sensing Science and Engineering, Faculty of Geographical Science, Beijing Normal University, Beijing 100875, China

YANG Zhi,  
  • Affiliation：

    State Key Laboratory of Remote Sensing Science, Beijing Normal University, Beijing 100875, China

    Beijing Engineering Research Center for Global Land Remote Sensing Products, Faculty of Geographical Science, Beijing Normal University, Beijing 100875, China

    Institute of Remote Sensing Science and Engineering, Faculty of Geographical Science, Beijing Normal University, Beijing 100875, China

DUAN Yaming

ملخص

Driven by big data, deep learning has been widely and successfully applied in many fields, such as computer vision and speech recognition. With the increase in network depth, deep learning models can determine the rules and layers of images and obtain high classification accuracy, so they have become a research hotspot in remote sensing image interpretation. As data-driven algorithms, deep learning models need a large number of labeled samples for training to ensure that the trained model can learn accurate and comprehensive sample features, and they exhibit good classification performance. However, although the development and maturity of remote sensing technology provide abundant remote sensing image sources for deep learning models, the application of deep learning technology in remote sensing is limited by expensive manually labeled samples,. In practical crop classification applications, the quantity and quality of existing ground truth samples are often insufficient to train a classification model with high performance.This study proposes a crop classification strategy for the deep learning model based on weak samples to verify the applicability of the deep learning model with weak samples.GF-1 was used as the data source, and the SVM classifier was used to classify three types of rice, corn, and other ground objects in Liaoning Province at the county level. The results were used as the training label samples of the deep learning model. This process included sub-county SVM classification, manual post-classification processing, cropland masking, and other operations. This human-computer interaction was chosen to ensure the accuracy of the results. In this study, samples with non-100% accuracy were labeled as weak samples. Then, a Deep Convolutional Neural Network (DCNN) model was used to train the weak samples and obtain the spatial distribution of rice and corn in Liaoning Province.Results showed that OA reached 0.90, and the F1 scores of rice and corn were 0.81 and 0.90, respectively. The spatial consistency with the SVM results was 0.90. The model showed good robustness under the different topography and landform types of the agricultural landscape with a median OA that was greater than 0.93. It overcame the influence of topography in the study area to a certain extent through subregion analysis. In the agricultural landscape with a complex planting structure, the proposed method still maintained a certain accuracy in crop classification. Subsequently, noise experiments were designed to analyze the influence of SVM label noise on model classification. The corn distribution in the original SVM training label was expanded from 1 to 40 times to obtain new labels, which were then used to train the DCNN model and predict the testing data. When the model was within five times the sample noise, that is, the sample maximum error area ratio was not more than 0.36, the model was robust to a certain extent, and the results could be maintained within a reliable accuracy range (OA remained to be greater than 0.86).In conclusion, this study verified that crop classification results obtained with the deep learning model whose training labels are based on traditional classification methods can achieve high recognition accuracy good robustness under different topography and landform types of agricultural landscapes and the feasibility of using traditional classification results as weak samples. The experiment on increasing noise in the weak samples showed that weak samples can be used to train DCNN as long as their identification accuracy is guaranteed, that is, the maximum error area ratio of samples is not more than 0.36. This approach further reduces the threshold of obtaining labeled samples via deep learning models. It makes up for the limitation of the deep learning model, which is highly dependent on a large number of manually labeled samples, and provides a new approach for large-area remote sensing crop classification.

مفهوم

Weak samples;Deep Convolutional Neural Networks (DCNN);deep learning;GF-1;Crop remote sensing classification

References

  1. 1.
    Audebert N, Le Saux B and Lefèvre S. 2018. Beyond RGB: very high resolution urban remote sensing with multimodal deep networks. ISPRS Journal of Photogrammetry and Remote Sensing, 140: 30-32
  2. 2.
    Ball J E, Anderson D T and Chan C S. 2017. Comprehensive survey of deep learning in remote sensing: theories, tools, and challenges for the community. Journal of Applied Remote Sensing, 11(4): 042609
  3. 3.
    Belgiu M and Drăguţ L. 2016. Random forest in remote sensing: a review of applications and future directions. ISPRS Journal of Photogrammetry and Remote Sensing, 114: 24-31
  4. 4.
    Cai Y P, Guan K Y, Peng J, Wang S W, Seifert C, Wardlow B and Li Z. 2018. A high-performance and in-season classification system of field-level crop types using time-series Landsat data and a machine learning approach. Remote Sensing of Environment, 210: 35-47
  5. 5.
    Duan Y M. 2020. Research on Cloud/Shadow Detection Method of Medium Resolution Remote Sensing Image Based on Deep Learning and Data Enhancement. Beijing: Beijing Normal University
  6. 6.
    Hao P Y, Di L P, Zhang C and Guo L Y. 2020. Transfer learning for crop classification with cropland data layer data (CDL) as training samples. Science of the Total Environment, 733: 138869
  7. 7.
    He K M, Zhang X Y, Ren S Q and Sun J. 2016. Deep residual learning for image recognition//Proceedings of 2016 IEEE Conference on Computer Vision and Pattern Recognition. Las Vegas: IEEE: 770-778
  8. 8.
    Hinton G E, Osindero S and Teh Y W. 2006. A fast learning algorithm for deep belief nets. Neural Computation, 18(7): 1527-1554
  9. 9.
    Holschneider M, Kronland-Martinet R, Morlet J and Tchamitchian P. 1990. A real-time algorithm for signal analysis with the help of the wavelet transform//Proceedings of Time-Frequency Methods and Phase Space Proceedings of the International Conference. Marseille: Springer: 286-297
  10. 10.
    Hu F, Xia G S, Hu J W and Zhang L P. 2015. Transferring deep convolutional neural networks for the scene classification of high-resolution remote sensing imagery. Remote Sensing, 7(11): 14680-14707
  11. 11.
    Jia K and Li Q Z. 2013. Review of features selection in crop classification using remote sensing data. Resources Science, 35(12): 2507-2516
  12. 12.
    Jia K, Wu B F and Li Q Z. 2013. Crop classification using HJ satellite multispectral data in the North China plain. Journal of Applied Remote Sensing, 7(1): 073576
  13. 13.
    Kaiser P, Wegner J D, Lucchi A, Jaggi M, Hofmann T and Schindler K. 2017. Learning aerial image segmentation from online maps. IEEE Transactions on Geoscience and Remote Sensing, 55(11): 6054-6068
  14. 14.
    Krizhevsky A, Sutskever I and Hinton G E. 2017. ImageNet classification with deep convolutional neural networks. Communications of the ACM, 60(6): 84-90
  15. 15.
    Kussul N, Lavreniuk M, Skakun S and Shelestov A. 2017. Deep learning classification of land cover and crop types using remote sensing data. IEEE Geoscience and Remote Sensing Letters, 14(5): 778-782
  16. 16.
    Li Y, Zhang H K and Shen Q. 2017. Spectral-spatial classification of hyperspectral imagery with 3D convolutional neural network. Remote Sensing, 9(1): 67
  17. 17.
    Liu D W, Han L and Han X Y. 2016. High spatial resolution remote sensing image classification based on deep learning. Acta Optica Sinica, 36(4): 0428001
  18. 18.
    Lu D and Weng Q. 2007. A survey of image classification methods and techniques for improving classification performance. International Journal of Remote Sensing, 28(5): 823-870
  19. 19.
    Murthy C S, Raju P V and Badrinath K V S. 2003. Classification of wheat crop with multi-temporal images: performance of maximum likelihood and artificial neural networks. International Journal of Remote Sensing, 24(23): 4871-4890
  20. 20.
    Qu J Y, Sun X and Gao X. 2016. Remote sensing image target recognition based on CNN. Foreign Electronic Measurement Technology, 35(8): 45-50
  21. 21.
    Rodriguez-Galiano V F, Ghimire B, Rogan J, Chica-Olmo M and Rigol-Sanchez J P. 2012. An assessment of the effectiveness of a random forest classifier for land-cover classification. ISPRS Journal of Photogrammetry and Remote Sensing, 67: 93-104
  22. 22.
    Roy D P, Wulder M A, Loveland T R, Woodcock C E, Allen R G, Anderson M C, Helder D, Irons J R, Johnson D M, Kennedy R, Scambos T A, Schaaf C B, Schott J R, Sheng Y, Vermote E F, Belward A S, Bindschadler R, Cohen W B, Gao F, Hipple J D, Hostert P, Huntington J, Justice C O, Kilic A, Kovalskyy V, Lee Z P, Lymburner L, Masek J G, McCorkel J, Shuai Y, Trezza R, Vogelmann J, Wynne R H and Zhu Z. 2014. Landsat-8: science and product vision for terrestrial global change research. Remote Sensing of Environment, 145: 154-172
  23. 23.
    Rudiyanto, Minasny B, Shah R M, Soh N C, Arif C and Setiawan B I. 2019. Automated near-real-time mapping and monitoring of rice extent, cropping patterns, and growth stages in Southeast Asia using sentinel-1 time series on a Google Earth Engine platform. Remote Sensing, 11(14): 1666
  24. 24.
    Shao Y, Fan X T, Liu H, Xiao J H, Ross S, Brisco B, Brown R and Staples G. 2001. Rice monitoring and production estimation using multitemporal RADARSAT. Remote Sensing of Environment, 76(3): 310-325
  25. 25.
    Song D J, Zhang C M, Yang X X, Li F, Han Y J, Gao S and Dong H Y. 2020. Extracting winter wheat spatial distribution information from GF-2 image. Journal of Remote Sensing, 24(5): 596-608
  26. 26.
    Wagner S. 2014. Combination of convolutional feature extraction and support vector machines for radar ATR//Proceedings of the 17 th International Conference on Information Fusion. Salamanca: IEEE: 1-6.
  27. 27.
    Wang N, Li Q Z, Du X, Zhang Y, Zhao L C and Wang H Y. 2017. Identification of main crops based on the univariate feature selection in Subei. Journal of Remote Sensing, 21(4): 519-530
  28. 28.
    Waske B and Benediktsson J A. 2007. Fusion of support vector machines for classification of multisensor data. IEEE Transactions on Geoscience and Remote Sensing, 45(12): 3858-3866
  29. 29.
    Wu J G. 2000. Landscape Ecology: Pattern, Process, Scale and Hierarchy. Beijing: Higher Education Press
  30. 30.
    Yang C H, Everitt J H and Murden D. 2011. Evaluating high resolution SPOT 5 satellite imagery for crop identification. Computers and Electronics in Agriculture, 75(2): 347-354
  31. 31.
    Yang H W and Tong X H. 2012. Application status of middle and high resolution remote sensing images in agriculture. Transactions of the Chinese Society of Agricultural Engineering, 28(24): 138-149
  32. 32.
    Zhang D J, Pan Y Z, Zhang J S, Hu T G, Zhao J H, Li N and Chen Q. 2020. A generalized approach based on convolutional neural networks for large area cropland mapping at very high resolution. Remote Sensing of Environment, 247: 111912
  33. 33.
    Zhang J K, Cheng Y P, Zhang F W, Yue D P, Guo X X, Dong H, Wang J P and Tang H C. 2012. Crops planting information extraction based on multi-temporal remote sensing images. Transactions of the Chinese Society of Agricultural Engineering, 28(2): 134-141
  34. 34.
    Zhao H S, Shi J P, Qi X J, Wang X G and Jia J Y. 2017. Pyramid scene parsing network//Proceedings of 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Honolulu: IEEE: 6230-6239
  35. 35.
    Zhong L H, Hu L N and Zhou H. 2019. Deep learning based multi-temporal crop classification. Remote Sensing of Environment, 221: 430-443
  36. 36.
    Zhuang F Z, Luo P, He Q and Shi Z Z. 2015. Survey on transfer learning research. Journal of Software, 26(1): 26-39

قراءة النص الكامل

The above content is generated by Large Model Translation. The translated content is for reference only. We do not assume any commercial or legal responsibilty for any consequences arising from the use of our website