Précédent|Prochain

Cultivated land extraction from high-resolution remote sensing images based on BECU-Net model with edge enhancement

  • role： First author第一作者
  • Affiliation：

    School of Computer and Information, Hefei University of Technology, Hefei 230601, China

    Anhui Key Laboratory of Industrial Safety and Emergency Technology, Hefei University of Technology, Hefei 230601, China

    Anhui Provincial Laboratory of Intelligent Interconnection System, Hefei University of Technology, Hefei 230601, China

  • Email：dzyhfut@hfut.edu.cn
  • Introduction：董张玉，研究方向为多源信息处理与遥感信息获取、处理及其应用。E-mail： dzyhfut@hfut.edu.cn
DONG Zhangyu123,  
  • Affiliation：

    School of Computer and Information, Hefei University of Technology, Hefei 230601, China

LI Jinhui1,  
  • Affiliation：

    School of Computer and Information, Hefei University of Technology, Hefei 230601, China

ZHANG Jin1,  
  • Affiliation：

    School of Computer and Information, Hefei University of Technology, Hefei 230601, China

YU Jinqiu1,  
  • Affiliation：

    School of Computer and Information, Hefei University of Technology, Hefei 230601, China

AN Sen1

résumé

Cultivated land cover, as an important technical index to reflect the dynamic changes of human activities and the utilization degree of land resources, has been widely utilized in the fields of food security assessment and land management decision making. Existing information extraction methods ignore the differential characteristics of the plots and the rich information found in edge details, which results in fragmented extraction results with fuzzy boundaries. Therefore, an improved model that couples semantic segmentation model and edge enhancement is proposed to better solve the problem of insufficient fitting of cultivated land edges and fully utilize the rich semantic features and edge information in remote sensing images. The edge loss is designed accordingly to further improve the training accuracy and model performance.We design an edge branching self-network formed by CoT unit, gated convolution, and SCSE attention mechanism to realize the information complementarity of edge and depth features. We construct a joint edge enhancement loss function called BE-loss with constraints to enhance the attention of the model to boundary information. On this basis, we construct a cultivated land information extraction model, that is, BECU-net, by combining the EfficientNet backbone network and U-frame. In the multi-feature input layer of this model, the index and texture features of the preprocessed data are pre-extracted, the input structure is adjusted, and the feature expression ability of the network is improved.The extraction accuracy of cultivated land is 94.13%, and the F1-score is 95.17%. Compared with PANet, the extraction accuracy increased by 15.01%, and the F1-score improved by 7.93%. Compared with DeeplabV3+ network, the extraction accuracy is enhanced by 2.03%, and the F1-score is increased by 1.15%. The edge of cultivated land extracted by BECU-Net model is clear, and it is close to the real edge shape of cultivated land. Few holes and islands are observed. The extracted large parcels are not missing, and the edges and corners are sharp. The extracted small parcels have clear outlines and small deformation. At various gaps and complex edges, the extraction effect of GID dataset is significantly improved compared with that of the five other models. The effect is significant when used for edge extraction, The sawtooth and cavity phenomena of cultivated land patches are effectively restrained as well.(1) The input layer of network structure with multiple features, including exponential features and texture features, can effectively reflect the characteristics of cultivated land. (2) The edge branch subnetwork focuses on processing the shape information to better identify the boundary details in the cultivated land image. Its edge features complement the depth features of the Efficient encoder, and they can be cascaded to fully utilize the shallow details. (3) The improved combined loss function called BE-Loss with regular term solves the problem of unbalanced training sample categories and non-edge pixel-dominated loss function. Overall, the algorithm in this study provides a technical reference for further solving the problem of fuzzy boundaries when extracting cultivated land information. It also offers theoretical support for the accurate division of complex boundaries.

mots-clés

remote sensing;edge enhancement;cultivated land extraction;semantic segmentation;U-Net;high resolution remote sensing image

References

  1. 1.
    Bao Y T, Liu W, Gao O Y, Lin Z K and Hu Q. 2021. E-Unet++: a semantic segmentation method for remote sensing images//2021 IEEE 4th Advanced Information Management, Communicates, Electronic and Automation Control Conference. Chongqing: IEEE: 1858-1862
  2. 2.
    Chen L C, Zhu Y K, Papandreou G, Schroff F and Adam H. 2018. Encoder-decoder with atrous separable convolution for semantic image segmentation//Proceedings of the 15th European Conference on Computer vision. Munich: Springer: 833-851
  3. 3.
    Chen Z X, Wang L M, Wu W B, Jiang Z W and Li H. 2016. Monitoring plastic-mulched farmland by Landsat-8 OLI imagery using spectral and textural features. Remote Sensing, 8(4): 353
  4. 4.
    Du G M, Gai Z X and Wang H Y. 2021. Theoretical explanation and research framework of cultivated-land fragmentation in China. Journal of Earth Sciences and Environment, 43(6): 997-1008
  5. 5.
    Fan D L, Su X Y, Weng B, Wang T S and Yang F Y. 2021. Research progress on remote sensing classification methods for farmland vegetation. AgriEngineering, 3(4): 971-989
  6. 6.
    Gan F P, Wang R S, Wang Y J and Fu Z W. 1999. The classification method based on remote sensing techniques for land use and cover. Remote Sensing for Land and Resources, 11(4): 40-45
  7. 7.
    Gong P and Howarth P J. 1990. The use of structural information for improving land-cover classification accuracies at the rural-urban fringe. Photogrammetric Engineering and Remote Sensing, 56(1): 67-73
  8. 8.
    He C, Li S L, Xiong D H, Fang P Z and Liao M S. 2020. Remote sensing image semantic segmentation based on edge information guidance. Remote Sensing, 12(9): 1501
  9. 9.
    Krizhevsky A, Sutskever I and Hinton G E. 2012. ImageNet classification with deep convolutional neural networks//Proceedings of the 25th International Conference on Neural Information Processing Systems. Lake Tahoe: Curran Associates Inc.: 1097-1105
  10. 10.
    Lee R Y, Chang K C, Ou D Y and Hsu C H. 2020. Evaluation of crop mapping on fragmented and complex slope farmlands through random forest and object-oriented analysis using unmanned aerial vehicles. Geocarto International, 35(12): 1293-1310
  11. 11.
    Li X Y, Sun X F, Meng Y X, Liang J J, Wu F and Li J W. 2020. Dice loss for data-imbalanced NLP tasks. arXiv preprint arXiv: 1911.02855
  12. 12.
    Li Y H, Yao T, Pan Y W and Mei T. 2023. Contextual transformer networks for visual recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, 45(2): 1489-1500
  13. 13.
    Liu G Y, Song X and Lv J. 2015. Framland parcels extraction from high-resolution remote sensing images based on the two-stage image classification//Proceedings Volume 9812, MIPPR 2015: Automatic Target Recognition and Navigation. Enshi: SPIE: 239-244
  14. 14.
    Long J, Shelhamer E and Darrell T. 2015. Fully convolutional networks for semantic segmentation//2015 IEEE Conference on Computer Vision and Pattern Recognition. Boston: IEEE: 3431-3440
  15. 15.
    Ma M N. 1987. Basic theories and methods of remote sensing visual interpretation. Remote Sensing Information, (3): 26-29
  16. 16.
    Mather P M. 1986. Review of: “Introductory Digital Image Processing: A Remote Sensing Perspective” By J. R. JENSEN: (Englewood Cliffs, New Jersey: Prentice Hall, 1986) [Pp. 368.] Price £53-45. International Journal of Remote Sensing, 7(12): 1836-1838
  17. 17.
    Pan Y Z, Hu T G, Zhu X F, Zhang J S and Wang X D. 2012. Mapping cropland distributions using a hard and soft classification model. IEEE Transactions on Geoscience and Remote Sensing, 50(11): 4301-4312
  18. 18.
    Ronneberger O, Fischer P and Brox T. 2015. U-Net: convolutional networks for biomedical image segmentation//18th International Conference on Medical Image Computing and Computer-Assisted Intervention. Munich: Springer: 234-241
  19. 19.
    Roy A G, Navab N and Wachinger C. 2018. Concurrent spatial and channel ‘squeeze and excitation’ in fully convolutional networks//21st International Conference on Medical Image Computing and Computer-Assisted Intervention. Granada: Springer: 421-429
  20. 20.
    Takikawa T, Acuna D, Jampani V and Fidler S. 2019. Gated-SCNN: gated shape CNNs for semantic segmentation. arXiv:1907.05740
  21. 21.
    Tan M X and Le Q V. 2020. EfficientNet: rethinking model scaling for convolutional neural networks. arXiv:1905.11946
  22. 22.
    Tong X Y, Xia G S, Lu Q K, Shen H F, Li S Y, You S C and Zhang L P. 2020. Land-cover classification with high-resolution remote sensing images using transferable deep models. Remote Sensing of Environment, 237: 111322
  23. 23.
    Verma A K, Garg P K and Prasad K S H. 2017. Sugarcane crop identification from LISS IV data using ISODATA, MLC, and indices based decision tree approach. Arabian Journal of Geosciences, 10(1): 16
  24. 24.
    Wu Y R, Wang W Z, Zhuang J X, Ma C F, Liu S H and Wu L Z. 2013. Extraction of saline land based on decision tree approach using Landsat TM DATA//2013 IEEE International Geoscience and Remote Sensing Symposium. Melbourne: IEEE: 3762-3765
  25. 25.
    Wu Z H, Lei S G, Bian Z F, Huang J and Zhang Y. 2019. Study of the desertification index based on the albedo-MSAVI feature space for semi-arid steppe region. Environmental Earth Sciences, 78(6): 232
  26. 26.
    Xia L G, Luo J C, Sun Y W and Yang H P. 2018. Deep extraction of cropland parcels from very high-resolution remotely sensed imagery//2018 7th International Conference on Agro-geoinformatics (Agro-geoinformatics). Hangzhou: IEEE: 1-5
  27. 27.
    Xu L, Ming D P, Zhou W, Bao H Q, Chen Y Y and Ling X. 2019. Farmland extraction from high spatial resolution remote sensing images based on stratified scale pre-estimation. Remote Sensing, 11(2): 108
  28. 28.
    Xu W N, Deng X P, Guo S X, Chen J S, Sun L Y, Zheng X R, Xiong Y F, Shen Y and Wang X Q. 2020. High-resolution u-net: preserving image details for cultivated land extraction. Sensors, 20(15): 4064
  29. 29.
    Yang B and Liu Y. 2008. Technological essentials of visual interpretation of agricultural remote sensing images. Modernizing Agriculture, (4): 37-39
  30. 30.
    Yang X, Zhu D M, Yang R S, Fu Z T and Xie W B. 2020. A visible-band remote sensing index for extracting impervious surfaces. Transactions of the Chinese Society of Agricultural Engineering, 36(8): 127-134
  31. 31.
    Zhang S L, Zhang H, Hu D B, Zeng D, Bian Z Y, Lu L J, Ma J H and Huang J. 2015. Edge-detecting operator-based selection of Huber regularization threshold for low-dose computed tomography imaging. Journal of Southern Medical University, 35(3): 375-379
  32. 32.
    Zheng C, Chen Y C, Shao J and Wang L G. 2022. An MRF-based multigranularity edge-preservation optimization for semantic segmentation of remote sensing images. IEEE Geoscience and Remote Sensing Letters, 19: 8008205
  33. 33.
    Zhou Z W, Siddiquee M M R, Tajbakhsh N and Liang J M. 2020. UNet++: redesigning skip connections to exploit multiscale features in image segmentation. IEEE Transactions on Medical Imaging, 39(6): 1856-1867
  34. 34.
    Zhu N Y, Liu C, Singer Z S, Danino T, Laine A F and Guo J. 2020. Segmentation with residual attention U-Net and an edge-enhancement approach preserves cell shape features. arXiv preprint arXiv: 2001.05548

Lire l'article complet

The above content is generated by Large Model Translation. The translated content is for reference only. We do not assume any commercial or legal responsibilty for any consequences arising from the use of our website