Mapping cropland at metric resolution using the spatiotemporal information from multi-source GF satellite data

  • role: First author第一作者
  • Affiliation:

    Macro Agriculture Research Institute, College of Resources and Environment, Huazhong Agricultural University, Wuhan 430070, China

  • Email:zhiwen.cai@webmail.hzau.edu.cn
  • Introduction:E-mail zhiwen.cai@webmail.hzau.edu.cn
CAI Zhiwen1,  
  • Affiliation:

    College of Urban and Environmental Sciences, Central China Normal University, Wuhan 430079, China

HE Zhen2,  
  • Affiliation:

    College of Urban and Environmental Sciences, Central China Normal University, Wuhan 430079, China

WANG Wenjing2,  
  • Affiliation:

    Macro Agriculture Research Institute, College of Resources and Environment, Huazhong Agricultural University, Wuhan 430070, China

YANG Jingya1,  
  • Affiliation:

    Macro Agriculture Research Institute, College of Resources and Environment, Huazhong Agricultural University, Wuhan 430070, China

WEI Haodong1,  
  • Affiliation:

    College of Urban and Environmental Sciences, Central China Normal University, Wuhan 430079, China

    State Key Laboratory of Remote Sensing Science, Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100101, China

WANG Cong23,  
  • role: Corresponding author通信作者
  • Affiliation:

    Macro Agriculture Research Institute, College of Resources and Environment, Huazhong Agricultural University, Wuhan 430070, China

    State Key Laboratory of Remote Sensing Science, Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100101, China

  • Email:xubaodong@mail.hzau.edu.cn
  • Introduction:E-mail xubaodong@mail.hzau.edu.cn
XU Baodong13*

résumé

Timely and accurate estimation of the spatial distribution of cropland is critical for agricultural production management, yield estimation, and planting structure adjustment. Previous studies on cropland mapping mostly focused on using moderate-/low-spatial-resolution images or single-phase high-spatial-resolution images, in which croplands in regions with fragmented landscapes and complex crop planting patterns are challenging to extract. The multi-source Gaofen (GF) satellites launched by China can provide images with high spatiotemporal resolution, thus presenting great potential for fine-scale cropland mapping with high accuracy. This study utilized GF-1, GF-2, and GF-6 satellites to explore a high-accuracy cropland mapping method at metric spatial resolution. Specifically, Cropland Extraction UNet (CEUNet) was developed based on the structure of UNet by integrating multi-temporal information from GF-1/6 and spatial details from GF-2 to fully exploit the spatial and temporal characteristics of cropland.To make full use of the details provided by high-spatial-resolution images, CEUNet adopted the same encoder structure as UNet. It consisted of the repeated application of two 3×3 convolutions (unpadded convolutions), each followed by a 2×2 max pooling operation with stride of 2 for down sampling. The input image size was gradually reduced at each down sampling step, and feature maps of each size were concatenated in the corresponding up-sample layer to extract the hierarchy of spatial information. Meanwhile, time-series feature maps of images with moderate to high spatial resolution were extracted by two consecutive 3×3 convolutional layers and a 1×1 convolutional layer. Then, the time-series and spatial feature maps were integrated via element-wise addition before they were sent to the decoder for pixel-wise classification.Evaluation results from randomly selected sample points showed that CEUNet achieved good performance with an overall accuracy of 92.92% over the whole of Qianjiang City, Hubei Province. The CEUNet-extracted cropland at the meter-level resolution was used to perform a wall-to-wall pixel comparison with the cropland extracted via semantic segmentation based on UNet by using multi-source remote sensing images with different resolutions (UNet_m). Semantic segmentation based on UNet using single-phase high-resolution images (UNet_s), object-based random forest classification (OBIA), and pixel-based random forest classification (RF) were employed to extract the results of cultivated land for comparison. The accuracy of cropland extraction by CEUNet was higher than that by others (the average F1 score was improved by about 0.04, 0.11, 0.21, and 0.21), indicating the effectiveness of the proposed approach for diverse agriculture landscapes. The F1 score of CEUNet was improved by about 0.09, 0.26, 0.27, and 0.27 over regions with high fragmentation and complex landscapes.

mots-clés

cropland extraction;multi-source remote sensing images;CNN;GF satellites

References

  1. 1.
    Baheti B, Innani S, Gajre S and Talbar S. 2020. Eff-UNet: a novel architecture for semantic segmentation in unstructured environment//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops. Seattle, WA, USA IEEE: 1473-1481
  2. 2.
    Bruzzone L and Carlin L. 2006. A multilevel context-based system for classification of very high spatial resolution images. IEEE Transactions on Geoscience and Remote Sensing, 44(9): 2587-2600
  3. 3.
    Cao K L and Zhang X L. 2020. An improved res-UNet model for tree species classification using airborne high-resolution images. Remote Sensing, 12(7): 1128
  4. 4.
    Chen K Q, Gao X, Yan M L, Zhang Y and Sun X. 2020. Building extraction in pixel level from aerial imagery with a deep encoder-decoder network. Journal of Remote Sensing, 24(9): 1134-1142
  5. 5.
    Du Z R, Yang J Y, Ou C and Zhang T T. 2019. Smallholder crop area mapped with a semantic segmentation deep learning method. Remote Sensing, 11(7): 888
  6. 6.
    Fritz S, See L, McCallum I, You L Z, Bun A, Moltchanova E, Duerauer M, Albrecht F, Schill C, Perger C, Havlik P, Mosnier A, Thornton P, Wood-Sichra U, Herrero M, Becker-Reshef I, Justice C, Hansen M, Gong P, Aziz S A, Cipriani A, Cumani R, Cecchi G, Conchedda G, Ferreira S, Gomez A, Haffani M, Kayitakire F, Malanding J, Mueller R, Newby T, Nonguierma A, Olusegun A, Ortner S, Rajak D R, Rocha J, Schepaschenko D, Schepaschenko M, Terekhov A, Tiangwa A, Vancutsem C, Vintrou E, Wu W B, Van Der Velde M, Dunwoody A, Kraxner F and Obersteiner M. 2015. Mapping global cropland and field size. Global Change Biology, 21(5): 1980-1992
  7. 7.
    Geiger F, Bengtsson J, Berendse F, Weisser W W, Emmerson M, Morales M B, Ceryngier P, Liira J, Tscharntke T, Winqvist C, Eggers S, Bommarco R, Pärt T, Bretagnolle V, Plantegenest M, Clement L W, Dennis C, Palmer C, Oñate J J, Guerrero I, Hawro V, Aavik T, Thies C, Flohre A, Hänke S, Fischer C, Goedhart P W and Inchausti P. 2010. Persistent negative effects of pesticides on biodiversity and biological control potential on European farmland. Basic and Applied Ecology, 11(2): 97-105
  8. 8.
    Godfray H C J, Beddington J R, Crute I R, Haddad L, Lawrence D, Muir J F, Pretty J, Robinson S, Thomas S M and Toulmin C. 2010. Food security: the challenge of feeding 9 billion people. Science, 327(5967): 812-818
  9. 9.
    Graesser J and Ramankutty N. 2017. Detection of cropland field parcels from Landsat imagery. Remote Sensing of Environment, 201: 165-180
  10. 10.
    Green R E, Cornell S J, Scharlemann J P W and Balmford A. 2005. Farming and the fate of wild nature. Science, 307(5709): 550-555
  11. 11.
    He M and Zhang J Y. 2005. Scientific research progress of global land-use and land-cover changes project. Land and Resources, (9): 22-25.
  12. 12.
    Kehoe L, Romero-Muñoz A, Polaina E, Estes L, Kreft H and Kuemmerle T. 2017. Biodiversity at risk under future cropland expansion and intensification. Nature Ecology and Evolution, 1(8): 1129-1135
  13. 13.
    Kingma D P and Ba J. 2014. Adam: a method for stochastic optimization. arXiv: 1412.6980
  14. 14.
    Kussul N, Lavreniuk M, Skakun S and Shelestov A. 2017. Deep learning classification of land cover and crop types using remote sensing data. IEEE Geoscience and Remote Sensing Letters, 14(5): 778-782
  15. 15.
    Li W J, Dong R M, Fu H H, Wang J, Yu L and Gong P. 2020. Integrating Google Earth imagery with Landsat data to improve 30-m resolution land cover mapping. Remote Sensing of Environment, 237: 111563.
  16. 16.
    Lin T Y, Goyal P, Girshick R, He K M and Dollár P. 2017. Focal loss for dense object detection//Proceedings of the IEEE International Conference on Computer Vision. Venice, Italy: IEEE: 2999-3007.
  17. 17.
    Lowder S K, Skoet J and Raney T. 2016. The number, size and distribution of farms, smallholder farms and family farms worldwide. World Development, 87: 16-29.
  18. 18.
    Milletari F, Navab N and Ahmadi S A. 2016. V-Net: fully convolutional neural networks for volumetric medical image segmentation//2016 Fourth International Conference on 3D Vision (3DV). Stanford, CA, USA: IEEE: 565-571
  19. 19.
    Ming D P, Ci T Y, Cai H Y, Li L X, Qiao C and Du J Y. 2012. Semivariogram-based spatial bandwidth selection for remote sensing image segmentation with mean-shift algorithm. IEEE Geoscience and Remote Sensing Letters, 9(5): 813-817
  20. 20.
    Ming D P, Li J, Wang J Y and Zhang M. 2015. Scale parameter selection by spatial statistics for GeOBIA: using mean-shift based multi-scale segmentation as an example. ISPRS Journal of Photogrammetry and Remote Sensing, 106: 28-41
  21. 21.
    Ming D P, Zhang X, Wang M and Zhou W. 2016. Cropland extraction based on OBIA and adaptive scale pre-estimation. Photogrammetric Engineering and Remote Sensing, 82(8): 635-644
  22. 22.
    Persello C, Tolpekin V A, Bergado J R and De By R A. 2019. Delineation of agricultural fields in smallholder farms from satellite images using fully convolutional networks and combinatorial grouping. Remote Sensing of Environment, 231: 111253
  23. 23.
    Pittman K, Hansen M C, Becker-Reshef I, Potapov P V and Justice C O. 2010. Estimating global cropland extent with multi-year MODIS data. Remote Sensing, 2(7): 1844-1863
  24. 24.
    Qin X F, Wu C Z, Chang H, Lu H and Zhang X D. 2020. Match feature u-net: dynamic receptive field networks for biomedical image segmentation. Symmetry, 12(8): 1230.
  25. 25.
    Rounsevell M D A, Ewert F, Reginster I, Leemans R and Carter T R. 2005. Future scenarios of European agricultural land use: II. Projecting changes in cropland and grassland. Agriculture, Ecosystems and Environment, 107(2/3): 117-135
  26. 26.
    Song D J, Zhang C M, Yang X X, Li F, Han Y J, Gao S and Dong H Y. 2020. Extracting winter wheat spatial distribution information from GF-2 image. Journal of Remote Sensing, 24(5): 596-608
  27. 27.
    Su T F, Li H Y, Zhang S W and Li Y X. 2015. Image segmentation using mean shift for extracting croplands from high-resolution remote sensing imagery. Remote Sensing Letters, 6(12): 952-961
  28. 28.
    Thenkabail P S and Wu Z T. 2012. An automated cropland classification algorithm (ACCA) for Tajikistan by combining Landsat, MODIS and secondary data. Remote Sensing, 4(10): 2890-2918
  29. 29.
    Waldner F, Canto G S and Defourny P. 2015. Automated annual cropland mapping using knowledge-based temporal features. ISPRS Journal of Photogrammetry and Remote Sensing, 110: 1-13
  30. 30.
    Waldner F and Diakogiannis F I. 2020. Deep learning on edge: extracting field boundaries from satellite images with a convolutional neural network. Remote Sensing of Environment, 245: 111741
  31. 31.
    Watkins B and Van Niekerk A. 2019. Automating field boundary delineation with multi-temporal Sentinel-2 imagery. Computers and Electronics in Agriculture, 167: 105078
  32. 32.
    White E V and Roy D P. 2015. A contemporary decennial examination of changing agricultural field sizes using Landsat time series data. Geo: Geography and Environment, 2(1): 33-54
  33. 33.
    Xia L G, Luo J C, Sun Y W and Yang H P. 2018. Deep extraction of cropland parcels from very high-resolution remotely sensed imagery//2018 7th International Conference on Agro-Geoinformatics (Agro-Geoinformatics). Hangzhou, China: IEEE: 1-5
  34. 34.
    Xie Y H, Lark T J, Brown J F and Gibbs H K. 2019. Mapping irrigated cropland extent across the conterminous United States at 30 m resolution using a semi-automatic training approach on Google Earth Engine. ISPRS Journal of Photogrammetry and Remote Sensing, 155: 136-149
  35. 35.
    Xiong J, Thenkabail P S, Tilton J C, Gumma M K, Teluguntla P, Oliphant A, Congalton R G, Yadav K and Gorelick N. 2017a. Nominal 30-m cropland extent map of continental Africa by integrating pixel-based and object-based algorithms using sentinel-2 and landsat-8 data on Google earth engine. Remote Sensing, 9(10): 1065
  36. 36.
    Xiong J, Thenkabail P S, Gumma M K, Teluguntla P, Poehnelt J, Congalton R G, Yadav K and Thau D. 2017b. Automated cropland mapping of continental Africa using Google Earth Engine cloud computing. ISPRS Journal of Photogrammetry and Remote Sensing, 126: 225-244
  37. 37.
    Xu J F, Zhang B M, Yu D H, Lin Y Z and Guo H T. 2020. Aircraft target change detection for high-resolution remote sensing images using multi-feature fusion. Journal of Remote Sensing, 24(1): 37-52
  38. 38.
    Xu J F, Zhu Y, Zhong R H, Lin Z X, Xu J L, Jiang H, Huang J F, Li H F and Lin T. 2020. DeepCropMapping: a multi-temporal deep learning approach with improved spatial generalizability for dynamic corn and soybean mapping. Remote Sensing of Environment, 247: 111946
  39. 39.
    Xu L, Ming D P, Zhou W, Bao H Q, Chen Y Y and Ling X. 2019. Farmland extraction from high spatial resolution remote sensing images based on stratified scale pre-estimation. Remote Sensing, 11(2): 108
  40. 40.
    Yang J W, Zhang J S, Zhu S, Xu Q, Zhang F, Yang Z J and Dong Z. 2019. Cropland mapping in fragmented agricultural landscape using modified pyramid scene parsing network//IGARSS 2019-2019 IEEE International Geoscience and Remote Sensing Symposium. Yokohama, Japan: IEEE: 9831-9834
  41. 41.
    Zhang D J, Pan Y Z, Zhang J S, Hu T G, Zhao J H, Li N and Chen Q. 2020a. A generalized approach based on convolutional neural networks for large area cropland mapping at very high resolution. Remote Sensing of Environment, 247: 111912
  42. 42.
    Zhang J, Xie T J, Yang C H, Song H B, Jiang Z, Zhou G S, Zhang D Y, Feng H and Xie J. 2020b. Segmenting purple rapeseed leaves in the field from UAV RGB imagery using deep learning as an auxiliary means for nitrogen stress detection. Remote Sensing, 12(9): 1403

Lire l'article complet

The above content is generated by Large Model Translation. The translated content is for reference only. We do not assume any commercial or legal responsibilty for any consequences arising from the use of our website