سابِق|تال

Building detection based on a boundary-regulated network and watershed segmentation

  • role： First author第一作者
  • Affiliation：

    College of Mathematics, Taiyuan University of Technology, Jinzhong 030600, China

  • Email：luozhuang726995@163.com
  • Introduction：罗壮，研究方向为计算数学、数据科学。E-mail： luozhuang726995@163.com
LUO Zhuang1,  
  • role： Corresponding author通信作者
  • Affiliation：

    College of Data Science, Taiyuan University of Technology, Jinzhong 030600, China

  • Email：liming01@tyut.edu.cn
  • Introduction：李明，研究方向为计算数学、数据科学。E-mail： liming01@tyut.edu.cn
LI Ming2*,  
  • Affiliation：

    Department of Earth System Science, Tsinghua University, Beijing 100084, China

ZHANG Dezhao3

ملخص

High-density urban cities contain numerous similar buildings positioned in close proximity. Building detection from high-spatial-resolution remote sensing imagery in such scenes remains a challenge in computer vision and remote sensing urban applications. The integration of traditional segmentation algorithms and a novel neural network is an effective approach for such challenging settings. Inspired by the recent success of deep-learning-based edge detection, a new building detection method aiming at accurate boundaries is proposed. In accordance with the characteristics of buildings and their border, this study improves the network structure and integrates the network with bottom-up watershed segmentation to improve boundary precision and classification accuracy.First, two auxiliary labels, namely, the building boundary and parting line, are derived from the original dataset through data preprocessing. Second, the newly proposed building detection frame called ICT-Net is improved by modifying its structure and loss function in accordance with the two auxiliary labels to obtain the probability of three classes. Lastly, a post-process integrating watershed segmentation with gradient-boosted regression trees is employed to achieve high-accuracy building detection. Specifically, a probability feature map is generated by merging the probability of three classes. Watershed segmentation with building marker thresholds is applied to obtain building instances from the probability feature map. Then, the building probability of each building instance predicted by gradient-boosted regression trees is used to select building instances, resulting in building detection results. Parameter selection is also implemented.The performance of the proposed method is validated on the INRIA dataset, which provides aerial orthorectified color imagery with a spatial resolution of 0.3 m and with corresponding ground truth labels for two semantic classes: building and not building. Experimental results suggest that data preprocessing and the application of boundary loss can obtain an improvement of 1% in terms of the Intersection over Union (IOU) of building detection. The post-process can take full advantage of probability information from the network, thereby effectively optimizing the building boundary. The post-process brings an improvement of 10.5% in terms of building instance recall compared with the results of the neural network. Our study achieves a building instance recall rate that is 22.9% higher than that of the original ICT-Net.A novel building detection method based on a boundary-regulated network and watershed segmentation is proposed in this study. Experimental results reveal the advantages of the enhanced-boundary-oriented data preprocessing and modified neural network and demonstrate that the proposed method can further improve prediction accuracy on a network basis. However, the excellent performance of the proposed method largely depends on parameter selection, and further improvements should be made in the future.

مفهوم

remote sensing;building detection;deep neural network;boundary loss;watershed segmentation;instance segmentation

References

  1. 1.
    Bokhovkin A and Burnaev E. 2019. Boundary loss for remote sensing imagery semantic segmentation//Proceedings of the 16th International Symposium on Neural Networks. Moscow, Russia: Springer: 388-401
  2. 2.
    Chatterjee B and Poullis C. 2019. On building classification from remote sensor imagery using deep neural networks and the relation between classification and reconstruction accuracy using border localization as proxy//Proceedings of the 16th Conference on Computer and Robot Vision. Kingston, ON, Canada: IEEE: 41-48
  3. 3.
    Chollet F. 2015. Keras.
  4. 4.
    Demir I, Koperski K, Lindenbaum D, Pang G, Huang J, Basu S, Hughes F, Tuia D and Raska R. 2018. DeepGlobe 2018: a challenge to parse the earth through satellite images//Proceedings of 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops. Salt Lake City, Utah: IEEE: 172-17209
  5. 5.
    Dosovitskiy A, Fischer P, Ilg E, Häusser P, Hazirbas C, Golkov V, Van Der Smagt P, Cremers D and Brox T. 2015. FlowNet: learning optical flow with convolutional networks. Proceedings of 2015 IEEE International Conference on Computer Vision. Santiago, Chile: IEEE: 2758-2766
  6. 6.
    Dozat T. 2016. Incorporating nesterov momentum into Adam[EB/OL]. Proceedings of International Conference on Learning Representations Workshop (1): 2013-2016[2019-09-20].
  7. 7.
    Goldman E, Herzig R, Eisenschtat A, Goldberger J and Hassner T. 2019. Precise detection in densely packed scenes//Proceedings of 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Long Beach, CA, USA: IEEE: 5222-5233
  8. 8.
    He K M, Gkioxari G, Dollár P and Girshick R. 2017. Mask R-CNN. Proceedings of the IEEE International Conference on Computer Vision. Venice, Italy: IEEE: 2980-2988
  9. 9.
    Hosang J, Benenson R, Dollár P and Schiele B. 2016. What makes for effective detection proposals? IEEE Transactions on Pattern Analysis and Machine Intelligence, 38(4): 814-830
  10. 10.
    Iglovikov V, Mushinskiy S and Osin V. 2017. Satellite imagery feature detection using deep convolutional neural network: a kaggle competition[J/OL]. arXiv preprint arXiv:1706.06169 [2019-09-20].
  11. 11.
    Jégou S, Drozdzal M, Vazquez D, Romero A and Bengio Y. 2017. The one hundred layers tiramisu: fully convolutional densenets for semantic segmentation. Proceedings of 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops. Honolulu, HI, USA: IEEE: 1175-1183
  12. 12.
    Ke G L, Meng Q, Finley T, Wang T F, Chen W, Ma W D, Ye Q W and Liu T Y. 2017. LightGBM: a highly efficient gradient boosting decision tree[C/OL]. Proceedings of Advances in Neural Information Processing Systems. Long Beach, California, USA. Curran Associates Inc: 3146-3154[2019-09-20].
  13. 13.
    Lin T Y, Goyal P, Girshick R, He K M and Dollár P. 2017. Focal loss for dense object detection. Proceedings of the IEEE International Conference on Computer Vision. Venice, Italy: IEEE: 2999-3007
  14. 14.
    Liow Y T and Pavlidis T. 1990. Use of shadows for extracting buildings in aerial images. Computer Vision, Graphics, and Image Processing, 49(2): 242-277
  15. 15.
    Liu Z J, Wang J and Liu W P. 2005. Building extraction from high resolution imagery based on multi-scale object oriented classification and probabilistic Hough transform//Proceedings of 2005 IEEE International Geoscience and Remote Sensing Symposium. Seoul, South Korea: IEEE: 2250-2253
  16. 16.
    Lv Z Y, Zhang P L, Benediktsson J A and Shi W Z. 2014. Morphological profiles based on differently shaped structuring elements for classification of images with very high spatial resolution. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 7(12): 4644-4652
  17. 17.
    Maggiori E, Tarabalka Y, Charpiat G and Alliez P. 2017. Can semantic labeling methods generalize to any city? The inria aerial image labeling benchmark//Proceedings of 2017 IEEE International Geoscience and Remote Sensing Symposium. Fort Worth, Texas, USA: IEEE: 3226-3229
  18. 18.
    Marmanis D, Schindler K, Wegner J D, Galliani S, Datcu M and Stilla U. 2018. Classification with an edge: improving semantic image segmentation with boundary detection. ISPRS Journal of Photogrammetry and Remote Sensing, 135: 158-172
  19. 19.
    Ming D P, Luo J C, Shen Z F, Wang M and Sheng H. 2005. Research on information extraction and target recognition from high resolution remote sensing image. Science of Surveying and Mapping, 30(3): 18-20
  20. 20.
    Ronneberger O, Fischer P and Brox T. 2015. U-Net: convolutional networks for biomedical image segmentation//Proceedings of 2015 International Conference on Medical Image Computing and Computer-Assisted Intervention. Munich, Germany: Springer: 234-241
  21. 21.
    Tan Q L. 2010. Urban building extraction from VHR multi-spectral images using object-based classification. Acta Geodaetica et Cartographica Sinica, 39(6): 618-623
  22. 22.
    Tian S H, Zhang X F, Tian J and Sun Q. 2016. Random forest classification of wetland landcovers from multi-sensor data in the arid region of Xinjiang, China. Remote Sensing, 8(11): 954
  23. 23.
    Van Der Walt S, Schönberger J L, Nunez-Iglesias J, Boulogne F, Warner J D, Yager N, Gouillart E, Yu T and the Scikit-Image Contributors. 2014. Scikit-image: image processing in Python. PeerJ, 2: e453
  24. 24.
    Wu H, Cheng Z P, Shi W Z, Miao Z L and Xu C C. 2014. An object-based image analysis for building seismic vulnerability assessment using high-resolution remote sensing imagery. Natural Hazards, 71(1): 151-174
  25. 25.
    Wu G, Guo Z, Shi X, Chen Q, Xu Y, Shibasaki R, Shao X. 2018. A boundary regulated network for accurate roof segmentation and outline extraction. Remote Sensing， 10(8), 1195

قراءة النص الكامل

The above content is generated by Large Model Translation. The translated content is for reference only. We do not assume any commercial or legal responsibilty for any consequences arising from the use of our website