سابِق|تال

Global-Local-Aware conditional random fields based building extraction for high spatial resolution remote sensing images

  • role： First author第一作者
  • Affiliation：

    School of Geography and Information Engineering, China University of Geosciences, Wuhan 430078, China

    National Engineering Research Center for Geographic Information System, China University of Geosciences,Wuhan 430078, China

  • Email：zhuqq@cug.edu.cn
  • Introduction：朱祺琪，1993年生，女， 副教授， 研究方向为多源遥感大数据提取分析及地学应用。E-mail： zhuqq@cug.edu.cn
ZHU Qiqi12,  
  • Affiliation：

    School of Geography and Information Engineering, China University of Geosciences, Wuhan 430078, China

LI Zhen1,  
  • Affiliation：

    School of Geography and Information Engineering, China University of Geosciences, Wuhan 430078, China

ZHANG Ya’nan1,  
  • Affiliation：

    School of Geography and Information Engineering, China University of Geosciences, Wuhan 430078, China

LI Jialun1,  
  • Affiliation：

    School of Geography and Information Engineering, China University of Geosciences, Wuhan 430078, China

DU Yuqiang1,  
  • role： Corresponding author通信作者
  • Affiliation：

    School of Geography and Information Engineering, China University of Geosciences, Wuhan 430078, China

    National Engineering Research Center for Geographic Information System, China University of Geosciences,Wuhan 430078, China

  • Email：guanqf@cug.edu.cn
  • Introduction：关庆锋，1977年生，男， 教授， 研究方向为时空大数据分析、挖掘及空间感知与计算。E-mail： guanqf@cug.edu.cn
GUAN Qingfeng12*,  
  • Affiliation：

    State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University,Wuhan 430071, China

LI Deren3

ملخص

Obtaining building distribution maps accurately and quickly has very important research value. For instance, it can help governments and non-governmental organizations plan urban infrastructure construction and assist disaster relief work. The Conditional Random Field (CRF) is widely used in building extraction tasks because of its flexible context information modeling and detail extraction capabilities. However, problems, such as blurry building boundaries, still exist when the CRF is used to extract buildings from high spatial resolution remote sensing images.This study proposed a Global-Local-Aware conditional random fields framework for building extraction. Global-Local-Aware D-LinkNet (GLD-LinkNet) is proposed to solve the boundary blur problem of unary potential in this framework. GLD-LinkNet makes up for the loss of local structural information by D-LinkNet while using multi-scale building information effectively. In addition, the segmentation priors are fused, and the label cost is introduced. The pairwise potential reflects the linear combination of the spatial relationship of neighboring pixels and the cost of the local class label. It can maintain the detailed information inside the buildings effectively. In addition, to solve the problem of spectral similarity between buildings and noise, a larger range of context information is used to fuse segmentation prior to the extraction of buildings. The framework can eliminate the influence of image noise and spectral diversity within class. Moreover, it can also keep the detailed information of ground objects and determine the clear boundaries of buildings.Experiments were carried out on the aerial building dataset and the satellite building dataset of the WHU building datasets. Experimental results demonstrate that the proposed dilated and segmented conditional random field framework is superior to the state-of-the art methods in terms of accuracy and IOU. The model proposed in this study, which performs well for building extraction of complex scenes, can maintain the detailed information of buildings effectively. In addition, it removes the small building blocks mistakenly extracted by D-LinkNet, and the problem of blurred building boundaries has also been improved effectively.The use of the global and local integrated D-LinkNet to model the unary potential of CRF can realize the effective combination of building features of different scales. It makes the structure of the obtained buildings more complete. Furthermore, by adding a segmentation prior to the construction of pairwise potential, a building classification map with a clean background can be obtained. The introduction of the local class label cost term also meets the high requirements of the building extraction task for the extraction of building detail information and can capture detailed information that is difficult to identify on the network. The proposed model was tested on aerial and satellite datasets, and the IoU indicators on the two datasets reach 91.72% and 89.82%, respectively. These values imply that the framework can adapt to aerial and satellite datasets.In the future, we will further study the application of large-scale high-resolution remote sensing images in building extraction and try to combine multi-source geographic information data to extract more complete building information.

مفهوم

high spatial resolution remote sensing image;building extraction;conditional random fields;GLD-Linknet;the class label cost

References

  1. 1.
    AkÇay H G and Aksoy S. 2008. Automatic detection of geospatial objects using multiple hierarchical segmentations. IEEE Transactions on Geoscience and Remote Sensing, 46(7): 2097-2111
  2. 2.
    Boykov Y, Veksler O and Zabih R. 2001. Fast approximate energy minimization via graph cuts. IEEE Transactions on Pattern Analysis and Machine Intelligence, 23(11): 1222-1239
  3. 3.
    Boykov Y Y and Jolly M P. 2001. Interactive graph cuts for optimal boundary & region segmentation of objects in N-D images//Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001. Vancouver: IEEE: 105-112
  4. 4.
    Chaurasia A and Culurciello E. 2017. Linknet: exploiting encoder representations for efficient semantic segmentation//2017 IEEE Visual Communications and Image Processing (VCIP). St. Petersburg: IEEE: 1-4
  5. 5.
    Chen K Q, Fu K, Gao X, Yan M L, Sun X and Zhang H. 2017. Building extraction from remote sensing images with deep learning in a supervised manner//2017 IEEE International Geoscience and Remote Sensing Symposium (IGARSS). Fort Worth: IEEE: 1672-1675
  6. 6.
    Chen K Q, Gao X, Yan M L, Zhang Y and Sun X. 2020. Building extraction in pixel level from aerial imagery with a deep encoder-decoder network. Journal of Remote Sensing, 24(9):1134-1142
  7. 7.
    Deng J, Dong W, Socher R, Li L J, Li K and Li F F. 2009. ImageNet: a large-scale hierarchical image database//2009 IEEE Conference on Computer Vision and Pattern Recognition. Miami: IEEE: 248-255
  8. 8.
    Gao X J, Wang M W, Yang Y W and Li G Q. 2018. Building extraction from RGB VHR images using shifted shadow algorithm. IEEE Access, 6: 22034-22045
  9. 9.
    He K M, Zhang X Y, Ren S Q and Sun J. 2016. Deep residual learning for image recognition//2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Las Vegas: IEEE: 770-778
  10. 10.
    Huang J F, Zhang X C, Xin Q C, Sun Y and Zhang P C. 2019. Automatic building extraction from high-resolution aerial images and LiDAR data using gated residual refinement network. ISPRS Journal of Photogrammetry and Remote Sensing, 151: 91-105
  11. 11.
    Huertas A and Nevatia R. 1988. Detecting buildings in aerial images. Computer Vision, Graphics, and Image Processing, 41(2): 131-152
  12. 12.
    Ji S P, Wei S Q and Lu M. 2019b. A scale robust convolutional neural network for automatic building extraction from aerial and satellite imagery. International Journal of Remote Sensing, 40(9): 3308-3322
  13. 13.
    Jun W, Qiming Q, Xin Y, Jianhua W, Xuebin Q and Xiucheng Y. 2016. A Survey of Building Extraction Methods from Optical High Resolution Remote Sensing Imagery, Remote Sensing Technology and Application, 31: 653-62
  14. 14.
    Kang W C, Xiang Y M, Wang F and You H J. 2019. EU-Net: an efficient fully convolutional network for building extraction from optical remote sensing images. Remote Sensing, 11(23): 2813
  15. 15.
    Karantzalos K and Paragios N. 2009. Recognition-driven two-dimensional competing priors toward automatic and accurate building detection. IEEE Transactions on Geoscience and Remote Sensing, 47(1): 133-144
  16. 16.
    Krähenbühl P and Koltun V. 2012. Efficient inference in fully connected CRFs with Gaussian edge potentials//Advances in Neural Information Processing Systems. London: MIT: 109-117
  17. 17.
    Krizhevsky A, Sutskever I and Hinton G E. 2012. ImageNet classification with deep convolutional neural networks//Proceedings of the 25th International Conference on Neural Information Processing Systems. Lake Tahoe: Curran Associates Inc.: 1097-1105
  18. 18.
    Kumar S and Hebert M H. 2003. Discriminative random fields: A discriminative framework for contextual interaction in classification//Proceedings Ninth IEEE International Conference on Computer Vision. Nice: IEEE: 1150-1157
  19. 19.
    Lafferty J D, McCallum A and Pereira F C N. 2001. Conditional random fields: probabilistic models for segmenting and labeling sequence data//Proceedings of the Eighteenth International Conference on Machine Learning. San Francisco: Morgan Kaufmann Publishers: 282-289
  20. 20.
    Lai X D, Yang J R, Li Y X and Wang M W. 2019. A building extraction approach based on the fusion of LiDAR point cloud and elevation map texture features. Remote Sensing, 11(14): 1636
  21. 21.
    Li E, Femiani J, Xu S B, Zhang X P and Wonka P. 2015. Robust rooftop extraction from visible band images using higher order CRF. IEEE Transactions on Geoscience and Remote Sensing, 53(8): 4483-4495
  22. 22.
    Li Q Y, Shi Y L, Huang X and Zhu X X. 2020. Building footprint generation by integrating convolution neural network with Feature Pairwise Conditional Random Field (FPCRF). IEEE Transactions on Geoscience and Remote Sensing, 58(11): 7502-7519
  23. 23.
    Liu F Y, Lin G H and Shen C H. 2015. CRF learning with CNN features for image segmentation. Pattern Recognition, 48(10): 2983-2992
  24. 24.
    Liu H, Luo J C, Huang B, Hu X D, Sun Y W, Yang Y P, Xu N and Zhou N. 2019a. DE-Net: deep encoding network for building extraction from high-resolution remote sensing imagery. Remote Sensing, 11(20): 2380
  25. 25.
    Liu P H, Liu X P, Liu M X, Shi Q, Yang J X, Xu X C and Zhang Y Y. 2019b. Building footprint extraction from high-resolution images via spatial residual inception convolutional neural network. Remote Sensing, 11(7): 830
  26. 26.
    Mayer H. 1999. Automatic object extraction from aerial imagery—a survey focusing on buildings. Computer Vision and Image Understanding, 74(2): 138-149 [10.1006/cviu.1999.0750]
  27. 27.
    Qiao C, Luo J C, Wu Q Y, Shen Z F and Wang H. 2008. Object-Oriented method based urban building extraction from high resolution remote sensing image. Geography and Geo-Information Science, 24(5): 36-39
  28. 28.
    Shrestha S and Vanneschi L. 2018. Improved fully convolutional network with conditional random fields for building extraction. Remote Sensing, 10(7): 1135
  29. 29.
    Sun J X, Li W H, Zhang Y and Gong W G. 2019. Building segmentation of remote sensing images using deep neural networks and domain transform CRF//Proceedings Volume 11155, Image and Signal Processing for Remote Sensing XXV. Strasbourg: SPIE: 111550N
  30. 30.
    Szummer M, Kohli P and Hoiem D. 2008. Learning CRFs using graph cuts//European Conference on Computer Vision. Marseille: ECCV
  31. 31.
    Teichmann M T T and Cipolla R. 2018. Convolutional CRFs for semantic segmentation[EB/OL].
  32. 32.
    Wang Y J, Jiang T P, Yu M, Tao S B, Sun J and Liu S. 2020. Semantic-based building extraction from LiDAR point clouds using contexts and optimization in complex environment. Sensors, 20(12): 3386
  33. 33.
    Wegne J D, Soergel U and Rosenhahn B. 2011. Segment-based building detection with conditional random fields//2011 Joint Urban Remote Sensing Event. Munich: IEEE: 205-208
  34. 34.
    Wu K S, Otoo E and Suzuki K. 2009. Optimizing two-pass connected-component labeling algorithms. Pattern Analysis and Applications, 12(2): 117-135
  35. 35.
    Xu L L, Clausi D A, Li F and Wong A. 2017. Weakly supervised classification of remotely sensed imagery using label constraint and edge penalty. IEEE Transactions on Geoscience and Remote Sensing, 55(3): 1424-1436
  36. 36.
    Xu Y Y, Wu L, Xie Z and Chen Z L. 2018. Building extraction in very high resolution remote sensing imagery using deep learning and guided filters. Remote Sensing, 10(1): 144
  37. 37.
    Zhao J, Zhong Y F and Zhang L P. 2015. Detail-preserving smoothing classifier based on conditional random fields for high spatial resolution remote sensing imagery. IEEE Transactions on Geoscience and Remote Sensing, 53(5): 2440-2452
  38. 38.
    Zhong P and Wang R S. 2010. Learning conditional random fields for classification of hyperspectral images. IEEE transactions on image processing, 19(7): 1890-1907
  39. 39.
    Zhou L C, Zhang C and Wu M. 2018. D-LinkNet: linknet with pretrained encoder and dilated convolution for high resolution satellite imagery road extraction//2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW). Salt Lake City: IEEE: 192-1924
  40. 40.
    Zhu Q, Wang J, Liu X Y, Zhou Z W, Ma Z W and Gao X J. 2020. Accurate extraction of buildings from remote sensing images based on improved Markov random field. Computer and Modernization, (7):104-110
  41. 41.
    Zhu Q Q. 2018. Topic Model for High Resolution Remote Sensing Imagery Semantic Scene Understanding. Wuhan: Wuhan University: 147

قراءة النص الكامل

The above content is generated by Large Model Translation. The translated content is for reference only. We do not assume any commercial or legal responsibilty for any consequences arising from the use of our website