سابِق|تال

Road extraction method of high-resolution remote sensing image on the basis of the spatial information perception semantic segmentation model

  • role： First author第一作者
  • Affiliation：

    School of Resources and Environmental Engineering, Anhui University, Hefei 230601, China

  • Email：x18301096@stu.ahu.edu.cn
  • Introduction：吴强强，研究方向为深度学习遥感影像信息提取。E-mail：x18301096@stu.ahu.edu.cn
WU Qiangqiang1,  
  • Affiliation：

    School of Resource and Environmental Science, Wuhan University, Wuhan 430079, China

WANG Shuai2,  
  • Affiliation：

    School of Resources and Environmental Engineering, Anhui University, Hefei 230601, China

WANG Biao1,  
  • role： Corresponding author通信作者
  • Affiliation：

    School of Resources and Environmental Engineering, Anhui University, Hefei 230601, China

    Anhui Engineering Research Center for Geographical Information Intelligent Technology, Hefei 230601, China

  • Email：wuyanlan@ahu.edu.cn
  • Introduction：吴艳兰，研究方向为遥感大数据智能技术研究。E-mail：wuyanlan@ahu.edu.cn
WU Yanlan13*

ملخص

With the rapid development of remote sensing satellite technology, the automatic extraction of high-resolution remote sensing images has become a popular research direction in the field of remote sensing. Deep learning methods have been applied in remote sensing image road information extraction and achieved significant results. However, due to convolution and pooling and other operations in network, road extraction methods based on the deep learning have some problems, such as the loss of spatial features and ground object details and the frequent occurrence of false extraction during road extraction. In order to solve these problems, this paper designs an improved road extraction semantic segmentation network model to mitigate the impact of the above network structure.The proposed method is based on ResNet and introduces coordinate convolution and a global information enhancement module before and after the coding structure, respectively. First, the network structure is mainly composed of residual units of ResNet, which has powerful feature extraction and multiplexing capabilities, and extracts road features of different scales and levels. Second, coordinate convolution reduces the spatial information loss and enhances the edge information. The coordinate convolution before the coding structure introduces spatial coordinate information, which is beneficial to enhancing the extraction of effective spatial information. Finally, global pooling can improve global context awareness. The global information enhancement module after the coding structure can effectively extract global context information through global pooling, thereby improving the accuracy of road classification and reducing the influence of natural scene factors, such as houses and tree shadows, to a certain extent.In this paper, the Massachusetts Roads dataset was used in the experiment, and the results obtained exhibited good accuracy. The Recall rate was 71.02%, the comprehensive evaluation index (F1 Score) was 76.35%, and the IoU reached 62.18%. The F1 Score and IoU indicators of the proposed method are approximately 1% higher than those in U-net and D-LinkNet and exceed those of DeeplabV3+ and Segnet, which are lower than D-LinkNet in the recall index only.The comparison of the experimental results indicates that the proposed method can effectively alleviate the spatial feature and context information losses on the basis of the deep learning road extraction method and completely extract the roads in remote sensing images. Moreover, the proposed method can effectively extract the road in the case of trees and building shadows, and multi-scale roads can also be accurately extracted.

مفهوم

deep learning;remote sensing image;road extraction;coordinate convolution;global information enhancement module

References

  1. 1.
    Alshehhi R, Marpu P R, Woon W L and Mura M D. 2017. Simultaneous extraction of roads and buildings in remote sensing imagery with convolutional neural networks. ISPRS Journal of Photogrammetry and Remote Sensing, 130: 139-149
  2. 2.
    Badrinarayanan V, Kendall A and Cipolla R. 2017. SegNet: a deep convolutional encoder-decoder architecture for image segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 39(12): 2481-2495
  3. 3.
    Chen L C, Zhu Y K, Papandreou G, Schroff F and Adam H. 2018. Encoder-decoder with atrous separable convolution for semantic image segmentation//15th European Conference on Computer Vision. Munich: Springer: 833-851
  4. 4.
    Chen Z, Ma H C and Li Y F. 2013. Extraction of road intersection from LiDAR point cloud data based on ATS and Snake. Remote Sensing for Land and Resources, 25(4): 79-84
  5. 5.
    Fu Z L, Yang Y W, Gao X J, Zhao X Y and Fan L. 2016. An optimization algorithm for multi-characteristics road network matching. Acta Geodaetica et Cartographica Sinica, 45(5): 608-615
  6. 6.
    Haverkamp D S. 2002. Extracting straight road structure in urban environments using IKONOS satellite imagery. Optical Engineering, 41(9): 2107-2110
  7. 7.
    He K M, Zhang X Y, Ren S Q and Sun J. 2016. Deep residual learning for image recognition//2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Las Vegas: IEEE: 770-778
  8. 8.
    Hong M Z, Guo J Q, Dai Y Z and Yin Z Y. 2019. A novel FMH model for road extraction from high-resolution remote sensing images in urban areas. Procedia Computer Science, 147: 49-55
  9. 9.
    Jiang Y T. 2019. Research on road extraction of remote sensing image based on convolutional neural network. EURASIP Journal on Image and Video Processing, 2019(1): 31
  10. 10.
    Kingma D P and Ba J. 2015. Adam: a method for stochastic optimization//3rd International Conference on Learning Representations. International Conference on Learning Representations Ithaca, NYarXiv.org,abs/1412.6980
  11. 11.
    Li J and Zhang Q D. 2017. Extracting and identifying urban roads from remote sensing images based on Hough transform. Computer Knowledge and Technology, 13(3): 172-174
  12. 12.
    Liu R, Lehman J, Molino P, Such F P, Frank E, Sergeev A and Yosinski J. 2018. An intriguing failing of convolutional neural networks and the CoordConv solution//32nd Conference on Neural Information Processing Systems. Montréal: Curran Associates Inc.: 9628-9639
  13. 13.
    Mnih V. 2013. Machine Learning for Aerial Image Labeling. Toronto: University of Toronto,70-90
  14. 14.
    Mnih V and Hinton G E. 2010. Learning to detect roads in high-resolution aerial images//11th European Conference on Computer Vision. Heraklion: Springer: 210-223
  15. 15.
    Mu H L, Zhang Y, Li H B, Guo Y R and Zhuang Y. 2016. Road extraction base on Zernike algorithm on SAR image//Proceedings of IEEE International Geoscience and Remote Sensing Symposium. Beijing: IEEE: 1274-1277
  16. 16.
    Nogueira K, Penatti O A B and dos Santos J A. 2017. Towards better exploiting convolutional neural networks for remote sensing scene classification. Pattern Recognition, 61: 539-556
  17. 17.
    Panboonyuen T, Jitkajornwanich K, Lawawirojwong S, Srestasathiern P and Vateekul P. 2017. Road segmentation of remotely-Sensed images using deep convolutional neural networks with landscape metrics and conditional random fields. Remote Sensing, 9(7): 680
  18. 18.
    Ronneberger O, Fischer P and Brox T. 2015. U-Net: convolutional networks for biomedical image segmentation//18th International Conference on Medical Image Computing and Computer-Assisted Intervention. Munich: Springer: 234-241
  19. 19.
    Sherrah J. 2016. Fully convolutional networks for dense semantic labelling of high-resolution aerial imagery. Computer Vision and Pattern Recognition
  20. 20.
    Song M J and Civco D. 2004. Road extraction using SVM and image segmentation. Photogrammetric Engineering and Remote Sensing, 70(12): 1365-1371
  21. 21.
    Wen G J and Wang R S. 2000. Automatic extraction of main roads from aerial remote sensing images. Journal of Software, 11(7): 957-964
  22. 22.
    Wu Y X and He K M. 2018. Group normalization//15th European Conference on Computer Vision (ECCV). Munich: Springer: 3-19
  23. 23.
    Xu R. 2014. A method of urban road extraction from remote sensing image combining shape features and homogeneity. Journal of Geomatics Science and Technology, 31(1): 53-56
  24. 24.
    Yu C Q, Wang J B, Peng C, Gao C X, Yu G and Sang N. 2018. Learning a discriminative feature network for semantic segmentation//2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Salt Lake City: IEEE: 1857-1866
  25. 25.
    Zhang Y H, He J, Kan X, Xia G H, Zhu L L and Ge T T. 2018. Summary of road extraction methods for remote sensing images. Computer Engineering and Applications, 54(13): 1-10, 51
  26. 26.
    Zhang Z X, Liu Q J and Wang Y H. 2018. Road extraction by deep residual U-Net. IEEE Geoscience and Remote Sensing Letters, 15(5): 749-753
  27. 27.
    Zhou J X, Zhou A F, Tao C, Gao C Q and Li J. 2013. A methodology for urban roads network extraction from high resolution remote sensing imagery. Journal of Central South University (Science and Technology), 44(6): 2385-2391
  28. 28.
    Zhou L C, Zhang C and Wu M. 2018. D-LinkNet: linkNet with pretrained encoder and dilated convolution for high resolution satellite imagery road extraction//2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW). Salt Lake City: IEEE: 182-186

قراءة النص الكامل

The above content is generated by Large Model Translation. The translated content is for reference only. We do not assume any commercial or legal responsibilty for any consequences arising from the use of our website