Précédent|Prochain

Point cloud benchmark dataset WHU-TLS and WHU-MLS for deep learning

  • role： First author第一作者
  • Affiliation：

    State Key Laboratory of Information Engineering in Surveying Mapping and Remote Sensing, Wuhan University, Wuhan 430079, China

    Engineering Research Center for Spatio-temporal Data Smart Acquisition and Application, Ministry of Education of China, Wuhan University, Wuhan 430079, China

  • Email：bshyang@whu.edu.cn
  • Introduction：杨必胜， 1974年生，男，教授，研究方向为无人机摄影测量与三维重建、点云智能处理、空间智能、GIS应用。E-mail：bshyang@whu.edu.cn
YANG Bisheng12,  
  • Affiliation：

    State Key Laboratory of Information Engineering in Surveying Mapping and Remote Sensing, Wuhan University, Wuhan 430079, China

    Engineering Research Center for Spatio-temporal Data Smart Acquisition and Application, Ministry of Education of China, Wuhan University, Wuhan 430079, China

HAN Xu12,  
  • role： Corresponding author通信作者
  • Affiliation：

    State Key Laboratory of Information Engineering in Surveying Mapping and Remote Sensing, Wuhan University, Wuhan 430079, China

    Engineering Research Center for Spatio-temporal Data Smart Acquisition and Application, Ministry of Education of China, Wuhan University, Wuhan 430079, China

  • Email：dongzhenwhu@whu.edu.cn
  • Introduction：董震，1988年生，男，副研究员，研究方向为点云智能处理、3D计算机视觉。E-mail：dongzhenwhu@whu.edu.cn
DONG Zhen12*

résumé

This paper aims to elaborate two large-scale point cloud benchmark datasets, namely, WHU-TLS and WHU-MLS, for deep learning purposes. The benchmark of the Whu-TLS data set comprises 115 scans and over 1740 million 3D points collected from 11 different environments (i.e., subway station, high-speed railway platform, mountain, forest, park, campus, residence, riverbank, heritage building, underground excavation, and tunnel environments) with variations in the point density, clutter, and occlusion. The aims of the proposed benchmark are to facilitate better comparisons and provide insights into the strengths and weaknesses of different registration approaches based on a common standard.The ground-truth transformations and registration graphs are also provided to allow researchers to evaluate their registration solutions and for environmental modeling. In addition, the Whu-TLS data set provides suitable data for applications in safe railway operation, river surveys and regulation, forest structure assessment, cultural heritage conservation, landslide monitoring, and underground asset management. WHU-MLS benchmark dataset includes more than 30 kinds of objects and 5000 typical instances in urban scene. We manually labeled MLS point cloud, each point with spatial coordinates and normal. We totally labeled 40 scenes with average number of points 8 million, of which 30 scenes are split for training and 10 scenes for testing.The coarse and fine categories are defined as follows. The Construction: building (including the building façade and other clutters in the building), fence (including isolation structure on the road and wall); Natural: trees, low vegetation, including grass, shrub and other low tree; Ground: driveway (not including road mark), non-drive way, the ground that does not belong to the driveway, road markings; Dynamic: person (including person and bikes), car; Pole: light, electric pole, municipal pole, signal light, detector, board (usually attached to the light). The semantic labeling and instance labeling in WHU-MLS provide important references for point cloud deep learning. On the one hand, these datasets can be used for point cloud deep learning networks the training, testing, and evaluation of point cloud deep learning networks. On the other hand, the benchmark datasets would can promote the benchmarking of state-of-the-art algorithms in this field, and ensure better comparisons on a common base. WHU-TLS and WHU-MLS are freely available can be used freely for scientific research. We hope that the Whu-TLS and Whu-MLS benchmark data sets meet the needs of the research community and becomes important data sets for the development of cutting-edge TLS point cloud registration and point cloud segmentation methods.

mots-clés

remote sensing;deep learning;registration;semantic segmentation;instance segmentation;benchmark

References

  1. 1.
    Behley J, Garbade M, Milioto A, Quenzel J, Behnke S, Stachniss C and Gall J. 2019. SemanticKITTI: a dataset for semantic scene understanding of liDAR sequences//Proceedings of 2019 IEEE/CVF International Conference on Computer Vision. Seoul, Korea (South): IEEE: 9296-9306
  2. 2.
    Campbell M, Egerstedt M, How J P and Murray R M. 2010. Autonomous driving in urban environments: approaches, lessons and challenges. Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, 368(1928): 4649-4672
  3. 3.
    Charles R Q, Su H, Kaichun M and Guibas L J. 2017. Pointnet: deep learning on point sets for 3D classification and segmentation//Proceedings of 2017 IEEE Conference on Computer Vision and Pattern Recognition. Honolulu, HI, USA: IEEE: 77-85
  4. 4.
    Dai A, Chang A X, Savva M, Halber M, Funkhouser T and Nießner M. 2017. Scannet: richly-annotated 3D reconstructions of indoor scenes//Proceedings of 2017 IEEE Conference on Computer Vision and Pattern Recognition. Honolulu, HI, USA: IEEE: 2432-2443
  5. 5.
    Deng H W, Birdal T and Ilic S. 2018a. PPFNet: global context aware local features for robust 3D point matching//Proceedings of 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Salt Lake City, UT, USA: IEEE: 195-205
  6. 6.
    Deng H W, Birdal T and Ilic S. 2018b. PPF-foldnet: unsupervised learning of rotation invariant 3D local descriptors//Proceedings of the 15th European Conference on Computer Vision. Munich: Springer: 620-638
  7. 7.
    Deng H W, Birdal T and Ilic S. 2019. 3D local features for direct pairwise registration//Proceedings of 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Long Beach, CA, USA: IEEE: 3239-3248
  8. 8.
    Dong Z, Liang F X, Yang B S, Xu Y S, Zang Y F, Li J P, Wang Y, Dai W X, Fan H C, Hyyppä J and Stilla U. 2020. Registration of large-scale terrestrial laser scanner Point Clouds: a Review and Benchmark. ISPRS Journal of Photogrammetry and Remote Sensing, 163: 327-342
  9. 9.
    Dong Z, Yang B S, Liang F X, Huang R G and Scherer S. 2018. Hierarchical registration of unordered TLS point clouds based on binary shape context descriptor. ISPRS Journal of Photogrammetry and Remote Sensing, 144: 61-79
  10. 10.
    Dong Z, Yang B S, Liu Y, Liang F X, Li B J and Zang Y F. 2017. A novel binary shape context for 3D local surface description. ISPRS Journal of Photogrammetry and Remote Sensing, 130: 431-452
  11. 11.
    Ge X M. 2017. Automatic markerless registration of point clouds with semantic-keypoint-based 4-points congruent sets. ISPRS Journal of Photogrammetry and Remote Sensing, 130: 344-357
  12. 12.
    Geiger A, Lenz P, Stiller C and Urtasun R. 2013. Vision meets robotics: the kitti dataset. The International Journal of Robotics Research, 32(11): 1231-1237
  13. 13.
    Guo Y L, Sohel F, Bennamoun M, Lu M and Wan J W. 2013. Rotational projection statistics for 3D local surface description and object recognition. International Journal of Computer Vision, 105(1): 63-86
  14. 14.
    Han L, Zheng T, Xu L and Fang L. 2020. Occuseg: occupancy-aware 3D instance segmentation//Proceedings of 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Seattle, WA, USA: IEEE: 2937-2946
  15. 15.
    Hu Q Y, Yang B, Xie L H, Rosa S, Guo Y L, Wang Z H, Trigoni N and Markham A. 2020. RandLA-Net: efficient semantic segmentation of large-scale point clouds//Proceedings of 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Seattle, WA, USA: IEEE: 11105-11114
  16. 16.
    Jiang L, Zhao H S, Shi S S, Liu S, Fu C W and Jia J Y. 2020. PointGroup: dual-set point grouping for 3D instance segmentation//Proceedings of 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Seattle, WA, USA: IEEE: 4866-4875
  17. 17.
    Levinson J, Askeland J, Becker J, Dolson J, Held D, Kammel S, Kolter J Z, Langer D, Pink O, Pratt V, Sokolsky M, Stanek G and Stavens D. 2011. Towards fully autonomous driving: Systems and algorithms//Proceedings of 2011 IEEE Intelligent Vehicles Symposium. Baden-Baden, Germany: IEEE: 163-168
  18. 18.
    Rusu R B, Blodow N and Beetz M. 2009. Fast point feature histograms (FPFH) for 3D registration//Proceedings of 2009 IEEE International Conference on Robotics and Automation. Kobe, Japan: IEEE: 3212-3217
  19. 19.
    Tan W K, Qin N N, Ma L F, Li Y, Du J, Cai G R, Yang K and Li J. 2020. Toronto-3D: a large-scale mobile lidar dataset for semantic segmentation of urban roadways//Proceedings of 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops. Seattle, WA, USA: IEEE: 797-806
  20. 20.
    Torralba A and Efros A A, 2011. Unbiased look at dataset bias//Proceedings of CVPR 2011. Providence, RI, USA: IEEE: 1521-1528
  21. 21.
    Wang L, Huang Y C, Hou Y L, Zhang S M and Shan J. 2019. Graph attention convolution for point cloud semantic segmentation//Proceedings of 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Long Beach, CA, USA: IEEE: 10288-10297
  22. 22.
    Wang Y and Solomon J M. 2019. Deep closest point: learning representations for point cloud registration//Proceedings of 2019 IEEE/CVF International Conference on Computer Vision. Seoul, Korea (South): IEEE: 3522-3531
  23. 23.
    Wu Z R, Song S R, Khosla A, Yu F, Zhang L G, Tang X O and Xiao J X. 2015. 3D shapenets: a deep representation for volumetric shapes///Proceedings of 2015 IEEE Conference on Computer Vision and Pattern Recognition. Boston, MA, USA: IEEE: 1912-1920
  24. 24.
    Yang B S and Dong Z. 2019. Progress and perspective of point cloud intelligence. Acta Geodaetica et Cartographica Sinica, 48(12): 1575-1585
  25. 25.
    Yang B S and Dong Z. 2020. Progress of point cloud intelligence，Beijing Science Press：1 （杨必胜, 董震. 2020. 点云智能处理. 北京: 科学出版社: 1）
  26. 26.
    Yang B S, Dong Z, Liang F X and Liu Y. 2016. Automatic registration of large-scale urban scene point clouds based on semantic feature points. ISPRS Journal of Photogrammetry and Remote Sensing, 113: 43-58
  27. 27.
    Yang B S, Dong Z, Zhao G and Dai W X. 2015. Hierarchical extraction of urban objects from mobile laser scanning data. ISPRS Journal of Photogrammetry and Remote Sensing, 99: 45-57
  28. 28.
    Yang B S and Zang Y F. 2014. Automated registration of dense terrestrial laser-scanning point clouds using curves. ISPRS Journal of Photogrammetry and Remote Sensing, 95: 109-121
  29. 29.
    Yew Z J and Lee G H. 2018. 3DFeat-Net: weakly supervised local 3D features for point cloud registration//Proceedings of the 15th European Conference on Computer Vision. Munich: Springer: 630-646
  30. 30.
    Yi L, Shao L, Savva M, Huang H B, Zhou Y, Wang Q R, Graham B, Engelcke M, Klokov R, Lempitsky V, Gan Y, Wang P Y, Liu K, Yu F G, Shui P P, Hu B Y, Zhang Y, Li Y Y, Bu R, Sun M C, Wu W, Jeong M, Choi J, Kim C, Geetchandra A, Murthy N, Ramu B, Manda M, Ramanathan M, Kumar G, Preetham P, Srivastava S, Bhugra S, Lall B, Haene C, Tulsiani S, Malik J, Lafer J, Jones R, Li
  31. 31.
    Yu Y T, Li J, Guan H Y, Wang C and Wen C L. 2016. Bag of contextual-visual words for road scene object detection from mobile laser scanning data. IEEE Transactions on Intelligent Transportation Systems, 17(12): 3391-3406

Lire l'article complet

The above content is generated by Large Model Translation. The translated content is for reference only. We do not assume any commercial or legal responsibilty for any consequences arising from the use of our website