предыдущий|следующий

Research progress of building reconstruction via airborne point clouds

  • role： First author第一作者
  • Affiliation：

    School of Geodesy and Geomatics, Wuhan University, Wuhan 430079, China

  • Email：dujianli@whu.edu.cn
  • Introduction：杜建丽，1982年生，女，博士研究生，研究方向为空间目标的光学、激光观测数据处理，轨道确定和预报，监测网优化等。E-mail：dujianli@whu.edu.cn；dujianli@pmo.ac.cn
Jianli DU1,  
  • Affiliation：

    College of Civil Engineering, Nanjing Forestry University, Nanjing 210037, China

Dong CHEN2,  
  • Affiliation：

    College of Resource Environment and Tourism, Capital Normal University, Beijing 100048, China

Zhenxin ZHANG3,  
  • Affiliation：

    State Key Laboratory of Remote Sensing Science, Beijing Normal University, Beijing 100875, China

Liqiang ZHANG4

реферат

Creating photorealistic building models from large-scale airborne point clouds is an important aspect of urban modeling. Given the complexity of airborne points (i.e., noise, outliers, occlusions, and irregularities) and diversified architectures in the real world, the problems associated with the creation of photorealistic building models pose great challenges, but these problems are not comprehensively addressed by most of the state-of-the-art methods. In this research, intelligent algorithms are developed to create large-scale LoD3 building models with accurate geometry, correct topology, and abundant semantics. The developed algorithms can enhance the abstraction/representation of building point clouds. First, from the perspective of building model mechanism, modeling algorithms are divided into five categories, each of which is reviewed and analyzed in depth. Then, the common problems are determined, and their possible solutions are given accordingly. Finally, the possible directions of future building reconstruction are predicted on the basis of airborne point clouds. We aim to provide beneficial inspiration and relevant references to enhance building modeling theories, develop more intelligent modeling algorithms, and create high-quality building models.

ключеви́че слова́

airborne LiDAR;airborne point clouds;3D building reconstruction;building geometric models;review

References

  1. 1.
    Algorri M E and Schmitt F. 1996. Mesh simplification. Computer Graphics Forum, 15(3): 77–86
  2. 2.
    Berger M, Tagliasacchi A, Seversky L M, Alliez P, Guennebaud G, Levine J A, Sharf A and Silva C T. 2017. A survey of surface reconstruction from point clouds. Computer Graphics Forum, 36(1): 301–329
  3. 3.
    Cao R J, Zhang Y J, Liu X Y and Zhao Z Z. 2017. 3D building roof reconstruction from airborne LiDAR point clouds: a framework based on a spatial database. International Journal of Geographical Information Science, 31(7): 1359–1380
  4. 4.
    Chen D, Wang R S and Peethambaran J. 2017. Topologically aware building rooftop reconstruction from airborne laser scanning point clouds. IEEE Transactions on Geoscience and Remote Sensing, 55(12): 7032–7052
  5. 5.
    Chen D, Zhang L Q, Li J and Liu R. 2012. Urban building roof segmentation from airborne LiDAR point clouds. International Journal of Remote Sensing, 33(20): 6497–6515
  6. 6.
    Chen D, Zhang L Q, Mathiopoulos P T and Huang X F. 2014. A methodology for automated segmentation and reconstruction of urban 3-D buildings from ALS point clouds. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 7(10): 4199–4217
  7. 7.
    Chen Y M, Cheng L, Li M C, Wang J C, Tong L H and Yang K. 2014. Multiscale grid method for detection and reconstruction of building roofs from airborne LiDAR data. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 7(10): 4081–4094
  8. 8.
    Cheng L, Gong J Y, Li M C, Liu Y X and Song X G. 2009. 3D building model reconstruction from multi-view aerial images and LiDAR data. Acta Geodaetica et Cartographica Sinica, 38(6): 494–501 (
  9. 9.
    Cheng L, Li M C, Gong J Y and Shan J. 2013. 3D reconstruction of building rooftops from LiDAR data and orthophoto. Geomatics and Information Science of Wuhan University, 38(2): 208–211, 216 (
  10. 10.
    Deng F, Xu G J, Feng C and Guan H Y. 2010. Building reconstruction using LiDAR data and airborne images. Journal of Geomatics, 35(1): 35–37 (
  11. 11.
    Elberink S O and Vosselman G. 2009. Building reconstruction by target based graph matching on incomplete laser data: analysis and limitations. Sensors, 9(8): 6101–6118
  12. 12.
    Gao M X, Xu X W, Klinger Y, van der Woerd J and Tapponnier P. 2017. High-resolution mapping based on an unmanned aerial vehicle (UAV) to capture paleoseismic offsets along the altyn-tagh fault, China. Scientific Reports, 7: 8281
  13. 13.
    Haala N and Brenner C. 1999. Virtual city models from laser altimeter and 2D map data. Photogrammetric Engineering and Remote Sensing, 65(7): 787–796
  14. 14.
    Haala N and Kada M. 2010. An update on automatic 3D building reconstruction. ISPRS Journal of Photogrammetry and Remote Sensing, 65(6): 570–580
  15. 15.
    Han F, Tu Z W and Zhu S C. 2004. Range image segmentation by an effective jump-diffusion method. IEEE Transactions on Pattern Analysis and Machine Intelligence, 26(9): 1138–1153
  16. 16.
    He M Z, Zhu Q, Du Z Q, Zhang Y T, Hu H, Lin Y G and Qi H. 2015. Contour cluster shape analysis for building damage detection from post-earthquake airborne LiDAR. Acta Geodaetica et Cartographica Sinica, 44(4): 407–413 (
  17. 17.
    Huang H, Brenner C and Sester M. 2013. A generative statistical approach to automatic 3D building roof reconstruction from laser scanning data. ISPRS Journal of Photogrammetry and Remote Sensing, 79: 29–43
  18. 18.
    Huang X F. 2013. Building reconstruction from airborne laser scanning data. Geo-spatial Information Science, 16(1): 35–44
  19. 19.
    Huang X F, Sohn C, Wang X and Zhang F. 2009. Roof detection using LiDAR data based on points’ normal with weight. Geomatics and Information Science of Wuhan University, 34(1): 24–27 (
  20. 20.
    Ju T, Losasso F, Schaefer S and Warren J. 2002. Dual contouring of hermite data. ACM Transactions on Graphics, 21(3): 339–346
  21. 21.
    Kada M and McKinley L. 2010. 3D building reconstruction from LiDAR based on a cell decomposition approach. Remote Sensing and Spatial Information Sciences, 38: 47-52.
  22. 22.
    Kim K and Shan J. 2011. Building roof modeling from airborne laser scanning data based on level set approach. ISPRS Journal of Photogrammetry and Remote Sensing, 66(4): 484–497
  23. 23.
    Lafarge F. 2015. Some new research directions to explore in urban reconstruction//Proceedings of 2015 Joint Urban Remote Sensing Event. Lausanne, Switzerland: IEEE: 1–4 [DOI: 10.1109/JURSE.2015.7120488]
  24. 24.
    Lafarge F, Descombes X, Zerubia J and Pierrot-Deseilligny M. 2008. Automatic building extraction from DEMs using an object approach and application to the 3D-city modeling. ISPRS Journal of Photogrammetry and Remote Sensing, 63(3): 365–381
  25. 25.
    Lafarge F, Descombes X, Zerubia J and Pierrot-Deseilligny M. 2010. Structural approach for building reconstruction from a single DSM. IEEE Transactions on Pattern Analysis and Machine Intelligence, 32(1): 135–147
  26. 26.
    Lafarge F and Mallet C. 2012. Creating large-scale city models from 3D-point clouds: a robust approach with hybrid representation. International Journal of Computer Vision, 99(1): 69–85
  27. 27.
    Levenberg K. 1944. A method for the solution of certain non-linear problems in least squares. Quarterly of Applied Mathematics, 2(2): 164–168
  28. 28.
    Li D R, Gong J Y and Shao Z F. 2010. From digital earth to smart earth. Geomatics and Information Science of Wuhan University, 35(2): 127–132 (
  29. 29.
    Li M L, Nan L L and Liu S C. 2016c. Fitting boxes to manhattan scenes using linear integer programming. International Journal of Digital Earth, 9(8): 806–817
  30. 30.
    Li M L, Nan L L, Smith N and Wonka P. 2016a. Reconstructing building mass models from UAV images. Computers and Graphics, 54: 84–93
  31. 31.
    Li M L, Wonka P and Nan L L. 2016b. Manhattan-world urban reconstruction from point clouds//Proceedings of the 14th European Conference on Computer Vision. Amsterdam, The Netherlands: Springer: 54–69
  32. 32.
    Li P C, Xing S, Xu Q, Zhou Y, Liu Z Q, Zhang Y and Geng X. 2014. An automated approach for complex shape building reconstruction with key point detection. Journal of Remote Sensing, 18(6): 1237–1246 (
  33. 33.
    Li R, Zhang X, Liu B and Zhang B. 2009. Review on methods of remote sensing time-series data reconstruction. Journal of Remote Sensing, 13(2): 335–341 (
  34. 34.
    Lin Y B, Wang C, Chen B L, Zai D W and Li J. 2017. Facet segmentation-based line segment extraction for large-scale point clouds. IEEE Transactions on Geoscience and Remote Sensing, 55(9): 4839–4854
  35. 35.
    Lin Y B, Wang C, Cheng J, Chen B L, Jia F K, Chen Z G and Li J. 2015. Line segment extraction for large scale unorganized point clouds. ISPRS Journal of Photogrammetry and Remote Sensing, 102: 172–183
  36. 36.
    Liu G Y, Ye X Q and Gu W K. 2003. 3D reconstruct based traffic flux detection algorithm. Journal of Image and Graphics, 8(6): 631–636 (
  37. 37.
    Liu Y W and Song S D. 2011. Complex building reconstruction based on multi-source data. Geomatics and Information Science of Wuhan University, 36(7): 780–784 (
  38. 38.
    Maas H G and Vosselman G. 1999. Two algorithms for extracting building models from raw laser altimetry data. ISPRS Journal of Photogrammetry and Remote Sensing, 54(2/3): 153–163
  39. 39.
    Mao B, Ban Y F and Harrie L. 2011. A multiple representation data structure for dynamic visualisation of generalised 3D city models. ISPRS Journal of Photogrammetry and Remote Sensing, 66(2): 198–208
  40. 40.
    Musialski P, Wonka P, Aliaga D G, Wimmer M, van Gool L and Purgathofer W. 2013. A survey of urban reconstruction. Computer Graphics Forum, 32(6): 146–177
  41. 41.
    Nan L L, Sharf A, Zhang H, Cohen-Or D and Chen B Q. 2010. SmartBoxes for interactive urban reconstruction. ACM Transactions on Graphics (TOG), 29(4): 93
  42. 42.
    Nan L L and Wonka P. 2017. Polyfit: polygonal surface reconstruction from point clouds//Proceedings of 2017 IEEE International Conference on Computer Vision. Venice, Italy: IEEE: 2372–2380
  43. 43.
    Neirotti P, De Marco A, Cagliano A C, Mangano G and Scorrano F. 2014. Current trends in smart city initiatives: some stylised facts. Cities, 38: 25–36
  44. 44.
    Oesau S, Lafarge F and Alliez P. 2016. Planar shape detection and regularization in tandem. Computer Graphics Forum, 35(1): 203–215
  45. 45.
    Poullis C. 2013. A framework for automatic modeling from point cloud data. IEEE Transactions on Pattern Analysis and Machine Intelligence, 35(11): 2563–2575
  46. 46.
    Poullis C and You S Y. 2009. Automatic reconstruction of cities from remote sensor data//Proceedings of 2009 IEEE Conference on Computer Vision and Pattern Recognition. Miami, FL, USA: IEEE: 2775–2782
  47. 47.
    Poullis C, You S Y and Neumann U. 2008. Rapid creation of large-scale photorealistic virtual environments//Proceedings of 2008 IEEE Virtual Reality Conference. Reno, NE, USA: IEEE: 153–160
  48. 48.
    Reale D, Fornaro G, Pauciullo A, Zhu X and Bamler R. 2011. Tomographic imaging and monitoring of buildings with very high resolution SAR data. IEEE Geoscience and Remote Sensing Letters, 8(4): 661–665
  49. 49.
    Rossignac J and Borrel P. 1993. Multi-resolution 3D approximations for rendering complex scenes//Falcidieno B, Kunii T L, eds. Modeling in Computer Graphics. Berlin, Heidelberg: Springer: 455–465
  50. 50.
    Sampath A and Shan J. 2010. Segmentation and reconstruction of polyhedral building roofs from aerial LiDAR point clouds. IEEE Transactions on Geoscience and Remote Sensing, 48(3): 1554–1567
  51. 51.
    Schnabel R, Wahl R and Klein R. 2007. Efficient RANSAC for point-cloud shape detection. Computer Graphics Forum, 26(2): 214–226
  52. 52.
    Schroeder W J, Zarge J A and Lorensen W E. 1992. Decimation of triangle meshes. ACM SIGGRAPH Computer Graphics, 26(2): 65–70
  53. 53.
    Shahzad M and Zhu X X. 2015. Robust reconstruction of building facades for large areas using spaceborne tomosar point clouds. IEEE Transactions on Geoscience and Remote Sensing, 53(2): 752–769
  54. 54.
    Sui W, Wang L F, Fan B, Xiao H F, Wu H Y and Pan C H. 2016. Layer-wise floorplan extraction for automatic urban building reconstruction. IEEE Transactions on Visualization and Computer Graphics, 22(3): 1261–1277
  55. 55.
    Sun X, Yang B S and Li Q Q. 2011. Structural segmentation method for 3D building models based on voxel analysis. Acta Geodaetica et Cartographica Sinica, 40(5): 582–586 (
  56. 56.
    Sun Y, Zhang X C and Luo G W. 2014. Improved active contour model for building roof boundary extraction from LiDAR point cloud. Acta Geodaetica et Cartographica Sinica, 43(6): 620–626, 636 (
  57. 57.
    Tong L H, Cheng L, Li M C, Chen Y M, Wang Y F and Zhang W. 2013. Extraction of building contours and corners from terrestrial LiDAR data. Journal of Image and Graphics, 18(7): 876–883 (
  58. 58.
    Usumezbas A, Fabbri R and Kimia B. 2016. From multiview image curves to 3D drawings//Proceedings of the 14th European Conference on Computer Vision. Amsterdam, The Netherlands: Springer: 70–87
  59. 59.
    Vanegas C A, Aliaga D G and Benes B. 2012. Automatic extraction of manhattan-world building masses from 3D laser range scans. IEEE Transactions on Visualization and Computer Graphics, 18(10): 1627–1637
  60. 60.
    Verdie Y, Lafarge F and Alliez P. 2015. LOD generation for urban scenes. ACM Transactions on Graphics, 34(3): 30
  61. 61.
    Verma V, Kumar R and Hsu S. 2006. 3D building detection and modeling from aerial LiDAR data//Proceedings of 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. New York, NY, USA: IEEE: 2213–2220
  62. 62.
    Vo H T, Callahan S P, Lindstrom P, Pascucci V and Silva C T. 2007. Streaming simplification of tetrahedral meshes. IEEE Transactions on Visualization and Computer Graphics, 13(1): 145–155
  63. 63.
    Wang H T, Zhang W M, Chen Y M, Chen M and Yan K. 2015. Semantic decomposition and reconstruction of compound buildings with symmetric roofs from LiDAR data and aerial imagery. Remote Sensing, 7(10): 13945–13974
  64. 64.
    Wang J and Xu K. 2017. Shape detection from raw LiDAR data with subspace modeling. IEEE Transactions on Visualization and Computer Graphics, 23(9): 2137–2150
  65. 65.
    Wang J, Xu Y, Remil O, Xie X, Ye N, Yi C and Wei M. 2016a. Automatic modeling of urban facades from raw LiDAR point data. Computer Graphics Forum, 35(7): 269–278
  66. 66.
    Wang J Y, Wen G J, Lv J J and Li D R. 2009. A review on reconstructing buildings. Remote Sensing Technology and Application, 24(6): 832–840 (
  67. 67.
    Wang R S, Peethambaran J and Chen D. 2018. LiDAR point clouds to 3-D urban models: a review. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 11(2): 606–627
  68. 68.
    Wang Y J, Xu H, Cheng L, Li M C, Wang Y J, Xia N, Chen Y M and Tang Y. 2016b. Three-dimensional reconstruction of building roofs from airborne LiDAR data based on a layer connection and smoothness strategy. Remote Sensing, 8(5): 415
  69. 69.
    Wang Z and Li Q Q. 2009. A method for 3D building models reconstruction from airborne LiDAR data based on discrete curvature analysis. Geography and Geo-Information Science, 25(1): 44–48 (
  70. 70.
    Wu B, Yu B L, Wu Q S, Yao S J, Zhao F, Mao W Q and Wu J P. 2017. A graph-based approach for 3D building model reconstruction from airborne LiDAR point clouds. Remote Sensing, 9(1): 92
  71. 71.
    Xia S B and Wang R S. 2017. A fast edge extraction method for mobile LiDAR point clouds. IEEE Geoscience and Remote Sensing Letters, 14(8): 1288–1292
  72. 72.
    Xiao J X and Furukawa Y. 2014. Reconstructing the world’s museums. International Journal of Computer Vision, 110(3): 243–258
  73. 73.
    Xiao Y, Wang C, Xi X H and Wang F J. 2014. 3D building model reconstruction from airborne LiDAR data. Science of Surveying and Mapping, 39(11): 37–41 (
  74. 74.
    Xiong B, Elberink S O and Vosselman G. 2014. A graph edit dictionary for correcting errors in roof topology graphs reconstructed from point clouds. ISPRS Journal of Photogrammetry and Remote Sensing, 93: 227–242
  75. 75.
    Xiong B, Jancosek M, Elberink S O and Vosselman G. 2015. Flexible building primitives for 3D building modeling. ISPRS Journal of Photogrammetry and Remote Sensing, 101: 275–290
  76. 76.
    Yan J H, Zhang K Q, Zhang C C, Chen S C and Narasimhan G. 2015. Automatic construction of 3-D building model from airborne LIDAR data through 2-D snake algorithm. IEEE Transactions on Geoscience and Remote Sensing, 53(1): 3–14
  77. 77.
    Yang B S and Jiang S B. 2011. Generating levels of detail of 3D building models based on cutting loops decomposition. Acta Geodaetica et Cartographica Sinica, 40(5): 575–581 (
  78. 78.
    Yang B S, Liang F X and Huang R G. 2017. Progress, challenges and perspectives of 3D LiDAR point cloud processing. Acta Geodaetica et Cartographica Sinica, 46(10): 1509–1516 (
  79. 79.
    Yi C, Zhang Y, Wu Q Y, Xu Y B, Remil O, Wei M Q and Wang J. 2017. Urban building reconstruction from raw LiDAR point data. Computer-Aided Design, 93: 1–14
  80. 80.
    Zeng Q H, Mao J H, Li X H and Liu X F. 2009. Bulding roof boundary extraction from LiDAR point cloud. Geomatics and Information Science of Wuhan University, 34(4): 383–386 (
  81. 81.
    Zeng Q H, Mao J H, Li X H and Liu X F. 2011. Building reconstruction from airborne LiDAR points cloud data. Geomatics and Information Science of Wuhan University, 36(3): 321–324 (
  82. 82.
    Zhang J X, Lin X G and Liang X L. 2017. Advances and Prospects of information extraction from point clouds. Acta Geodaetica et Cartographica Sinica, 46(10): 1460–1469 (
  83. 83.
    Zhang J, Li L L and Jiang W S. 2010. Contour clustering analysis for building reconstruction from LIDAR data. Journal of Geo-Information Science, 12(5): 641–648 (
  84. 84.
    Zhang K, Yan J and Chen S C. 2006. Automatic construction of building footprints from airborne LIDAR data. IEEE Transactions on Geoscience and Remote Sensing, 44(9): 2523–2533
  85. 85.
    Zhang L Q, Li Z Q, Li A J and Liu F Y. 2018. Large-scale urban point cloud labeling and reconstruction. ISPRS Journal of Photogrammetry and Remote Sensing, 138: 86–100
  86. 86.
    Zhang W, Grussenmeyer P, Yan G and Mohamed M. 2011. Primitive-based building reconstruction by integration of LiDAR data and optical imagery. International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 38: 7–12
  87. 87.
    Zhang W M, Wang H T, Chen Y M, Yan K and Chen M. 2014. 3D building roof modeling by optimizing primitive’s parameters using constraints from LiDAR data and aerial imagery. Remote Sensing, 6(9): 8107–8133
  88. 88.
    Zhang X H and Geng J H. 2006. Building reconstruction from airborne laser altimetry points cloud data set based on invariant moments. Geomatics and Information Science of Wuhan University, 31(2): 168–171 (
  89. 89.
    Zhao C, Zhang B M, Chen X W, Guo H T and Lu J. 2017. Accurate and automatic building roof extraction using neighborhood information of point clouds. Acta Geodaetica et Cartographica Sinica, 46(9): 1123–1134 (
  90. 90.
    Zheng Q, Sharf A, Wan G W, Li Y Y, Mitra N J, Cohen-Or D and Chen B Q. 2010. Non-local scan consolidation for 3D urban scenes. ACM Transactions on Graphics (TOG), 29(4): 94
  91. 91.
    Zheng Y F and Weng Q H. 2015. Model-driven reconstruction of 3-d buildings using LiDAR data. IEEE Geoscience and Remote Sensing Letters, 12(7): 1541–1545
  92. 92.
    Zhou Q Y and Neumann U. 2008. Fast and extensible building modeling from airborne LiDAR data//Proceedings of the 16th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems. Irvine, California: ACM: 7
  93. 93.
    Zhou Q Y and Neumann U. 2010. 2.5D dual contouring: a robust approach to creating building models from aerial LiDAR point clouds//Proceedings of the 11th European Conference on Computer Vision. Heraklion, Crete, Greece: Springer: 115–128
  94. 94.
    Zhou Q Y and Neumann U. 2011. 2.5D building modeling with topology control//Proceedings of 2011 IEEE Conference on Computer Vision and Pattern Recognition. Colorado, CO, USA: IEEE: 2489–2496
  95. 95.
    Zhou Q Y and Neumann U. 2013. Complete residential urban area reconstruction from dense aerial LiDAR point clouds. Graphical Models, 75(3): 118–125
  96. 96.
    Zhu Q. 2014. Full three-dimensional GIS and its key roles in smart city. Journal of Geo-Information Science, 16(2): 151–157 (

Читать полностью

The above content is generated by Large Model Translation. The translated content is for reference only. We do not assume any commercial or legal responsibilty for any consequences arising from the use of our website