Generation method of hand-drawn feature sketch virtual terrain based on improved generative adversarial network

  • role: First author第一作者
  • Affiliation:

    School of Earth and Space Sciences, Peking University, Beijing 100871, China

  • Email:xiaoyuan_zhang@stu.pku.edu.cn
  • Introduction:E-mailxiaoyuan_zhang@stu.pku.edu.cn
ZHANG Xiaoyuan,  
  • role: Corresponding author通信作者
  • Affiliation:

    School of Earth and Space Sciences, Peking University, Beijing 100871, China

  • Email:gischen@pku.edu.cn
  • Introduction:E-mailgischen@pku.edu.cn
CHEN Bin*

реферат

The 3D virtual terrain generation is currently used in geography teaching and setting up relevant virtual scenes according to the teaching content, which can visually display the verification experimental conditions and results and enhance the universality of virtual geography experiments. In the field of digital twin smart city, traffic, and water simulation, constructing virtual terrain according to the real terrain can provide the basic environment for subsequent development and experiments. In military simulation, it can quickly build beyond the real scenes of extreme training environment, which has a key role in improving military training and enhancing combat capabilities. Hand-drawn feature sketches can express 3D virtual terrain under human subjective perception. Therefore, how to use hand-drawn feature sketches to build 3D terrain environment quickly and generate realistic virtual geographic environment is a hot spot and difficult point for the creation and development of geographic metaverse with virtual geographic environment as the core in the future. Although the traditional method of generating 3D virtual terrain provides an important reference for image cross-domain generation from hand-drawn feature sketch to virtual terrain, problems such as insufficient realism of the generated terrain remain. Especially when the terrain feature outline is too sparse, the generated terrain will have duplicate terrain blocks and grid artifacts. On this basis, a hand-drawn feature sketch virtual terrain generation method with improved generative adversarial network is proposed. The model is based on extracted data samples and hand-drawn sketch characteristics, and the input terrain feature information is involved in the sampling of each layer by improving the generator U-Net network, which enhances the control role of terrain features in the invisible space, reduces the possibility of model collapse, increases the random noise input, and improves the realism of the generated terrain, especially the detail when the terrain feature elements in the sketch are sparse. L1 loss (mean absolute value error function) and L2 loss (mean variance error function) are combined to form smooth L1 loss, and then optimized with CGAN loss function to form a new generator loss function to improve the stability and efficiency of model training. The Digital Elevation Model (DEM) data of some areas of the Loess Plateau with high accuracy is selected to produce data. The DEM data with high accuracy are selected and used for model training to compare and evaluate the terrain generation enhancement effect quantitatively before and after model improvement. Finally, the model inference process from hand-drawn feature sketch to virtual terrain is completely constructed. The experimental results show the improved virtual terrain generation model with the Loess Plateau terrain data can represent the hand-drawn feature sketch well, and the generated terrain conforms to the distribution and orientation of the terrain features described in the sketch, especially in the case of sparse sketch, and the generated terrain has high realistic surface details. This model is applied to the real natural landscape display and terrain evolution, and it can meet the user’s needs to obtain the virtual terrain with high realistic feeling after inputting the hand-drawn terrain feature sketch. This improved model proposed in this paper has good prospects for 3D terrain modeling and editing.

ключеви́че слова́

remote sensing;3D virtual terrain;CGANs;Hand-drawn feature sketch;DEM

References

  1. 1.
    Barnes R, Lehman C and Mulla D. 2014. An efficient assignment of drainage direction over flat surfaces in raster digital elevation models. Computers and Geosciences, 62: 128-135
  2. 2.
    Cao Y J, Jia L L, Chen Y X, Lin N and Li X X. 2018. Review of computer vision based on generative adversarial networks. Journal of Image and Graphics, 23(10): 1433-1449
  3. 3.
    Gregory D, Johnston R, Pratt G, Watts M J and Whatmore S. 2009. The Dictionary of Human Geography: Mental Maps/Cognitive Maps. 5th ed. Hoboken: Wiley-Blackwell
  4. 4.
    Guan W J, Cao B, Wang X Y and Ma F Y. 2017. Comparison of river information extraction methods. Yellow River, 39(2): 51-55
  5. 5.
    Guérin É, Digne J, Galin É, Peytavie A, Wolf C, Benes B and Martinez B. 2017. Interactive example-based terrain authoring with conditional generative adversarial networks. ACM Transactions on Graphics, 36(6): 228
  6. 6.
    Isola P, Zhu J Y, Zhou T H and Efros A A. 2017. Image-to-image translation with conditional adversarial networks//Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition. Honolulu: IEEE: 5967-5976
  7. 7.
    Jiang S, Tang G A, Yang X, Xiong L Y and Qian C Y. 2021. Conceptual model of terrain texture in Loess Plateau based on DEM. Journal of Geo-Information Science, 23(6): 959-968
  8. 8.
    Jing K. 1986. A study on gully erosion on the Loess Plateau. Scientia Geographica Sinica, 6(4): 340-347
  9. 9.
    Lin H, Gong J H and Shi J J. 2003. From maps to GIS and VGE—A discussion on the evolution of the geographic language. Geography and Geo-Information Science, 19(4): 18-23
  10. 10.
    Lin H, Hu M Y, Chen M, Zhang F, You L and Chen Y T. 2020. Cognitive transformation from geographic information system to virtual geographic environments. Journal of Geo-Information Science, 22(4): 662-672
  11. 11.
    Lin H, Huang F R, Lu X J, Hu M Y, Xu B L and Wu L. 2010. Preliminary study on virtual geographic environment cognition and representation. Journal of Remote Sensing (in Chinese), 14(4): 822-838
  12. 12.
    Lin H, Huang F R and Lü G N. 2009. Development of virtual geographic environments and the new initiative in experimental geography. Acta Geographica Sinica, 64(1): 7-20
  13. 13.
    Liu H and Xue M. 2021. Exploring the use of virtual geographic environments for geo-spatial cognition research. National Remote Sensing Bulletin, 25(10): 2027-2039
  14. 14.
    Mirza M and Osindero S. 2014. Conditional generative adversarial nets. arXiv:1411.1784
  15. 15.
    Ronneberger O, Fischer P and Brox T. 2015. U-Net: convolutional networks for biomedical image segmentation. arXiv:1505.04597
  16. 16.
    Tang G A, Na J M and Cheng W M. 2017. Progress of digital terrain analysis on regional geomorphology in China. Acta Geodaetica et Cartographica Sinica, 46(10): 1570-1591
  17. 17.
    Yu R L, Liu Y and Wang A. 2007. Contrast of interference stripes in optical fiber Michelson interferometer. Journal of Atmospheric and Environmental Optics, 2(3): 231-235
  18. 18.
    Zhou C H, Cheng W M, Qian J K, Li B Y and Zhang B P. 2009. Research on the classification system of digital land geomorphology of 1: 1000 000 in China. Journal of Geo-Information Science, 11(6): 707-724
  19. 19.
    Zhou H, Sun J, Turk G and Rehg J M. 2007. Terrain synthesis from digital elevation models. IEEE Transactions on Visualization and Computer Graphics, 13(4): 834-848
  20. 20.
    Zhou Y, Tang G A, Wang C, Xiao C C, Dong Y F and Sun J L. 2010. Automatic segmentation of loess positive and negative terrains based on high resolution grid DEMs. Scientia Geographica Sinica, 30(2): 261-266

Читать полностью

The above content is generated by Large Model Translation. The translated content is for reference only. We do not assume any commercial or legal responsibilty for any consequences arising from the use of our website