Detection of water conservancy facilities in large-format image combining E-YOLO algorithm and NDWI constraint

  • role: First author第一作者
  • Affiliation:

    National Engineering Research Center for Geomatics, Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100101, China

    School of Electronic, Electrical and Communication Engineering, University of Chinese Academy of Sciences, Beijing 100049, China

  • Email:xuzeyu@aircas.ac.cn
  • Introduction:E-mail xuzeyu@aircas.ac.cn
XU Zeyu12,  
  • role: Corresponding author通信作者
  • Affiliation:

    National Engineering Research Center for Geomatics, Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100101, China

    College of Resources and Environment, University of Chinese Academy of Sciences, Beijing 100049, China

  • Email:shenzf@aircas.ac.cn
  • Introduction:E-mail shenzf@aircas.ac.cn
SHEN Zhanfeng13*,  
  • Affiliation:

    National Engineering Research Center for Geomatics, Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100101, China

    State Key Laboratory of Remote Sensing Science, Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100101, China

LI Yang14,  
  • Affiliation:

    State Key Laboratory of Desert and Oasis Ecology, Xinjiang Institute of Ecology and Geography, Chinese Academy of Sciences, Ürümqi 830011, China

    Key Laboratory of GIS and RS Application, Xinjiang Uygur Autonomous Region, Ürümqi 830011, China

LI Junli56,  
  • Affiliation:

    National Engineering Research Center for Geomatics, Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100101, China

    School of Electronic, Electrical and Communication Engineering, University of Chinese Academy of Sciences, Beijing 100049, China

WANG Haoyu12,  
  • Affiliation:

    National Engineering Research Center for Geomatics, Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100101, China

    State Key Laboratory of Remote Sensing Science, Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100101, China

LI Shuo14,  
  • Affiliation:

    National Engineering Research Center for Geomatics, Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100101, China

    School of Electronic, Electrical and Communication Engineering, University of Chinese Academy of Sciences, Beijing 100049, China

JIAO Shuhui12,  
  • Affiliation:

    National Disaster Reduction Center of China, Beijing 100124, China

LI Lingling7

resumen

Water facilities play an important role in water scheduling, ecological protection and restoration of natural wetlands, utilization of resources and functions, and development. The traditional methods of statistics on the location and count of water conservancy facilities rely on compiled data, which has disadvantages such as time-consuming, untimely data update, and unknown specific geographic locations. Remote sensing provides new possibilities for large-scale detection of water conservancy facilities. Aiming at the problem of detection of water conservancy facilities with remote sensing images, this study proposes a large-scale image detection algorithm. Based on the YOLO v3 network and the characteristics of water conservancy facilities, the study was divided into two main aspects: (1) We improved the YOLO algorithm and obtained the E-YOLO algorithm. We proposed a PPA feature fusion method and a four-feature map cross prediction method with proportional prediction box to optimize the problems of small samples. Besides, we improved the loss function by highlighting the loss of confidence. In addition, we used the transfer learning method to read part of the feature extraction parameters of the pre-trained model. (2) With the improved E-YOLO algorithm as the core, a large-area water conservancy facility detection algorithm combined with the water body index constraint was obtained. Aiming at the problem of large image size with a small target scale, we used the water body index to constrain the sliding step to reduce the missed detection rate and false detection rate at the same time. Then we combined the network output with the contour merging method to optimize the detection results. We used the GF-2 data for this study. The experimental results show that: the E-YOLO algorithm can significantly improve the detection effect of water conservancy facilities. Compared with YOLO v3, the average F2 score of E-YOLO is increased by 1.25% and the E-YOLO algorithm has a better stability. The large-area detection method constrained by the water index can improve the detection accuracy while ensuring efficiency. Compared with the large-step and small-step methods, its F2 accuracy is increased by 3.72% and 2.70%, respectively. Our method provides a good solution for the detection of water conservancy facilities.

palabra clave

water conservancy facilities;remote sensing detection;E-YOLO;large image;NDWI

References

  1. 1.
    Audebert N, Le Saux B and Lefèvre S. 2018. Beyond RGB: very high resolution urban remote sensing with multimodal deep networks. ISPRS Journal of Photogrammetry and Remote Sensing, 140: 20-32
  2. 2.
    Fang H W and Shi H J. 2019. Satellite image recognition and classification method based on deep learning. Computer Systems & Applications, 28(10): 27-34
  3. 3.
    Girshick R, Donahue J, Darrell T and Malik J. 2014. Rich feature hierarchies for accurate object detection and semantic segmentation//Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition. Columbus, OH: IEEE: 580-587
  4. 4.
    He K M, Zhang X Y, Ren S Q and Sun J. 2016. Deep residual learning for image recognition//Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition. Las Vegas, NV: IEEE: 770-778
  5. 5.
    Hoeser T, Bachofer F and Kuenzer C. 2020. Object detection and image segmentation with deep learning on earth observation data: a review—part ii: applications. Remote Sensing, 12(18): 3053
  6. 6.
    Hong L, Huang Y J, Yang K, Peng S Y and Xu Q L. 2019. Study on urban surface water extraction from heterogeneous environments using GF-2 remotely sensed images. Journal of Remote Sensing, 23(5): 871-882
  7. 7.
    Li H F, Dou X, Tao C, Wu Z X, Chen J, Peng J, Deng M and Zhao L. 2020. RSI-CB: a large-scale remote sensing image classification benchmark using crowdsourced data. Sensors, 20(6): 1594
  8. 8.
    Liu J G, Zang C F, Tian S Y, Liu J G, Yang H, Jia S F, You L Z, Liu B and Zhang M. 2013. Water conservancy projects in China: achievements, challenges and way forward. Global Environmental Change, 23(3): 633-643
  9. 9.
    Liu K, Ren H G, Li S Y and Qin B Y. 2019. Automatic extraction of Tibet Plateau frozen lake based on Tiangong-2 multi-spectral data. Infrared and Laser Engineering, 48(3): 40-46
  10. 10.
    Liu W, Anguelov D, Erhan D, Szegedy C, Reed S, Fu C Y and Berg A C. 2016. SSD: single shot multibox detector//Proceedings of the 14th European Conference on Computer Vision. Amsterdam: Springer: 21-37
  11. 11.
    Luo J C, Sheng Y W, Shen Z F, Li J L and Gao L J. 2009. Automatic and high-precise extraction for water information from multispectral images with the step-by-step iterative transformation mechanism. Journal of Remote Sensing, 13(4): 610-615
  12. 12.
    Ma X, Shao L M, Jin X and Xu G L. 2019. Improved YOLO model and its application in ship target recognition. Telecommunication Engineering, 59(8): 869-874
  13. 13.
    McFeeters S K. 1996. The use of the normalized difference water index (NDWI) in the delineation of open water features. International Journal of Remote Sensing, 17(7): 1425-1432
  14. 14.
    Neubeck A and van Gool L. 2006. Efficient non-maximum suppression//Proceedings of the 18th International Conference on Pattern Recognition. Hong Kong: IEEE: 850-855
  15. 15.
    Redmon J, Divvala S, Girshick R and Farhadi A. 2016. You only look once: unified, real-time object detection//Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition. Las Vegas, NV: IEEE: 779-788
  16. 16.
    Redmon J and Farhadi A. 2017. YOLO9000: better, faster, stronger//Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition. Honolulu, HI: IEEE: 6517-6525
  17. 17.
    Redmon J and Farhadi A. 2018. YOLOv3: an incremental improvement. arXiv: 1804.02767v1
  18. 18.
    Ren S Q, He K M, Girshick R and Sun J. 2017. Faster R-CNN: towards real-time object detection with region proposal networks. IEEE Transactions on Pattern Analysis and Machine Intelligence, 39(6): 1137-1149
  19. 19.
    Shen Z F, Xia L G, Li J L, Luo J C and Hu X D. 2013. Automatic and high-precision extraction of rivers from remotely sensed images with Gaussian normalized water index. Journal of Image and Graphics, 18(4): 421-428
  20. 20.
    Shi W Z, Caballero J, Huszár F, Totz J, Aitken A P, Bishop R, Rueckert D and Wang Z H. 2016. Real-time single image and video super-resolution using an efficient sub-pixel convolutional neural network//Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition. Las Vegas, NV: IEEE: 1874-1883
  21. 21.
    Tao Z Y. 2021. Detection and recognition of base in large-format remote sensing images. Huazhong University of Science & Technology
  22. 22.
    Wang N, Cheng J H, Zhang H Y, Cao H J and Liu J. 2020. Application of U-net model to water extraction with high resolution remote sensing data. Remote Sensing for Land and Resources, 32(1): 35-42
  23. 23.
    Wang X K, Jiang H X and Lin K Y. 2020. Remote sensing image ship detection based on modified YOLO algorithm. Journal of Beijing University of Aeronautics and Astronautics, 46(6): 1184-1191
  24. 24.
    Wu J, Duan J, He L Q, Li Y C and Zhu W T. 2021. Research on aircraft detection algorithm of DS-YOLO network in remote sensing images. Computer Engineering and Applications, 57(1): 181-187
  25. 25.
    Xu Y, Zhang Y J and Zhang Q. 2016. Rule sets building of water conservancy facilities spatial element extraction based on high resolution remote sensing image. Geospatial Information, 14(5): 71-74
  26. 26.
    Zhang Z X. 2018. Fast Detection of Aircraft Target in Large-Scale Optical Remote Sensing Image. Changchun: University of Chinese Academy of Sciences (Changchun Institute of Optics, Fine Mechanics, Chinese Academy of Sciences)
  27. 27.
    Zheng Z Q, Liu Y Y, Pan C C and Li G N. 2019. Application of improved YOLO v3 in aircraft recognition of remote sensing images. Electronics Optics and Control, 26(4): 28-32
  28. 28.
    Zhou L L. 2010. Study on water resource market allocation in Turim river basin. Xinjiang Agricultural University

Leer el texto completo

The above content is generated by Large Model Translation. The translated content is for reference only. We do not assume any commercial or legal responsibilty for any consequences arising from the use of our website