Effects of image input size and resolution by CNN on the classification accuracy for coniferous forest vegetation in western Sichuan

  • role: First author第一作者
  • Affiliation:

    China University of Geosciences (Wuhan), School of Geography and Information Engineering, Laboratory of Regional Ecological Processes and Environmental Evolution, Wuhan 430074, China

  • Email:shiweibo@cug.edu.cn
  • Introduction:E-mailshiweibo@cug.edu.cn
SHI Weibo1,  
  • role: Corresponding author通信作者
  • Affiliation:

    Institute of Geographic Sciences and Natural Resources Research, Chinese Academy of Sciences, State Key Laboratory of Resources and Environmental Information System, Beijing 100101, China

    Research Center for UAV Applications and regulation, Chinese Academy of Sciences, Beijing 100101, China

    Key Laboratory of Low Altitude Geographic Information and Air Route, Civil Aviation Administration of China, Beijing 100101, China

  • Email:liaoxh@igsnrr.ac.cn
  • Introduction:E-mailliaoxh@igsnrr.ac.cn
LIAO Xiaohan234*,  
  • Affiliation:

    China University of Geosciences (Wuhan), School of Geography and Information Engineering, Laboratory of Regional Ecological Processes and Environmental Evolution, Wuhan 430074, China

    Institute of Geographic Sciences and Natural Resources Research, Chinese Academy of Sciences, Key Laboratory of Ecosystem Network Observation and Modeling, Beijing 100101, China

    University of Chinese Academy of Sciences, College of Resources and Environment, Beijing 100049, China

WANG Shaoqiang156,  
  • Affiliation:

    Institute of Geographic Sciences and Natural Resources Research, Chinese Academy of Sciences, State Key Laboratory of Resources and Environmental Information System, Beijing 100101, China

    Research Center for UAV Applications and regulation, Chinese Academy of Sciences, Beijing 100101, China

    Key Laboratory of Low Altitude Geographic Information and Air Route, Civil Aviation Administration of China, Beijing 100101, China

YUE Huanyin234,  
  • Affiliation:

    Institute of Geographic Sciences and Natural Resources Research, Chinese Academy of Sciences, State Key Laboratory of Resources and Environmental Information System, Beijing 100101, China

    Research Center for UAV Applications and regulation, Chinese Academy of Sciences, Beijing 100101, China

WANG Dongliang23

Resümee

The subalpine coniferous forest in west Sichuan is located in southwest China, which is affected by cloudy, rainy, and foggy conditions. Thus, conducting vegetation classification in the area by using satellite images is difficult.(Objective)Therefore, this work selects Wanglang Nature Reserve, which is a typical area of subalpine coniferous forest in western Sichuan, as the study area. A multi-rotor UAV is used to acquire high-resolution RGB images of the northern part of the study area, and it is combined with a convolutional neural network model for vegetation classification.(Method)This study selects the semantic segmentation method (U-Net) for classification, constructs vegetation classification models based on UAV images of different spatial resolutions and sample sets under different tile sizes, and establishes a forest fingerprint library to further explore the potential of convolutional neural networks on UAV remote sensing images.(Result)(1) The combination of UAV visible images and convolutional neural network model for classification can obtain classification results of high accuracy, which reached the optimum at a spatial resolution of 5 cm and a size of 256×256. The overall accuracy was 93.21%, and the kappa coefficient was 0.90. (2) The increase in ultrahigh spatial resolution had limited improvement on the model accuracy. When the spatial resolution was increased from 10 cm to 5 cm, the overall accuracy of the model improved by 0.02 and the Kappa coefficient improved by 0.03, and the classification accuracy of the model did not improve significantly. (3) Choosing the appropriate size can improve the classification accuracy of the model. Under the spatial resolution of 5 cm, the overall accuracy of the model with the size of 128×128 was 82.30% and the kappa coefficient was 0.76, and the overall accuracy of the model with the size of 256×256 was 93.21% and the kappa coefficient was 0.90. (4) For the vegetation types that were underrepresented in the region, the influence of spatial resolution and tile size was much higher than that of the dominant tree species, especially the influence of spatial resolution was the highest. The producer and user accuracies for deciduous shrubs at a spatial resolution of 20 cm were below 70%.(Conclusion)This study shows that vegetation classification of subalpine coniferous forests in western Sichuan using UAV high-resolution RGB images combined with convolutional neural networks can achieve high-precision classification results. The effects of UAV spatial resolution and tile sizes on the accuracy of convolutional neural network models are explored, which further details the potential of convolutional neural networks on UAV high-resolution RGB images to provide an automatic and accurate research method for vegetation classification in this region.

Schlüsselwort

UAV RGB imagery;Convolutional Neural Network(CNN);subalpine coniferous forest in western Sichuan;vegetation classification;tile size;spatial resolution

References

  1. 1.
    Cao Z. 2016. Present situation and forecast on forest investigation and monitoring by unmanned aerial vehicle. Forestry Construction, (6): 1-5
  2. 2.
    Colomina I and Molina P. 2014. Unmanned aerial systems for photogrammetry and remote sensing: a review. ISPRS Journal of Photogrammetry and Remote Sensing, 92: 79-97
  3. 3.
    Dai P Q, Ding L X, Liu L J, Dong L F and Huang Y T. 2020. Tree species identification based on FCN using the visible images obtained from an unmanned aerial vehicle. Laser and Optoelectronics Progress, 57(10): 101001
  4. 4.
    Du Z, Gan S S and Hu J. 2014. Characteristics and protection strategy of forest resources in the alpine region of southwest China. Forest Resources Management, (Z1): 27-31
  5. 5.
    Fassnacht F E, Latifi H, Stereńczak K, Modzelewska A, Lefsky M, Waser L T, Straub C and Ghosh A. 2016. Review of studies on tree species classification from remotely sensed data. Remote Sensing of Environment, 186: 64-87
  6. 6.
    Gu R H. 2005. Analysis and estimation for the landescapes of the nature as the Wanglang national preserve. Journal of Biology, 22(3): 1-4
  7. 7.
    Hao Z B, Lin L L, Post C J, Mikhailova E A, Li M H, Chen Y, Yu K Y and Liu J. 2021. Automated tree-crown and height detection in a young forest plantation using mask region-based convolutional neural network (Mask R-CNN). ISPRS Journal of Photogrammetry and Remote Sensing, 178: 112-123
  8. 8.
    He C, Zhang S Y and Yao S R. 2014. Forest fires locating technology based on rotor UAV. Bulletin of Surveying and Mapping, (12): 24-27
  9. 9.
    He K M, Zhang X Y, Ren S Q and Sun J. 2016. Deep residual learning for image recognition//2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Las Vegas: IEEE: 770-778
  10. 10.
    Huang H Y, Ma X H, Hu L L, Huang Y H and Huang H H. 2021. The preliminary application of the combination of Fast R-CNN deep learning and UAV remote sensing in the monitoring of pine wilt disease. Journal of Environmental Entomology, 43(5): 1295-1303
  11. 11.
    Iverson L R, Perera A H, Pastur G M and Peterson U. 2018. Ecosystem services from forest landscapes: where we are and where we go//Perera A H, Peterson U, Martínez Pastur G and Iverson L R, eds. Ecosystem Services from Forest Landscapes. Cham: Springer: 249-258
  12. 12.
    Jia L, Zheng K, Tang P and Huo L Z. 2022. Topographic correction effect on classification accuracy for deep neural network classifier—A case study of the U-Net model. National Remote Sensing Bulletin, 26(4): 698-710
  13. 13.
    Kattenborn T, Leitloff J, Schiefer F and Hinz S. 2021. Review on Convolutional Neural Networks (CNN) in vegetation remote sensing. ISPRS Journal of Photogrammetry and Remote Sensing, 173: 24-49
  14. 14.
    Liao L L, Zhou L, Wang S Q and Wang X Q. 2016. Carbon sequestration potential of biomass carbon pool for new afforestation in China during 2005-2013. Acta Geographica Sinica, 71(11): 1939-1947
  15. 15.
    Liao X H, Xiao Q and Zhang H. 2019. UAV remote sensing: popularization and expand application development trend. Journal of Remote Sensing, 23(6): 1046-1052
  16. 16.
    Liao X H, Zhou C H, Su F Z, Lu H Y, Yue H Y and Gou J P. 2016. The mass innovation era of UAV remote sensing. Journal of Geo-Information Science, 18(11): 1439-1447
  17. 17.
    Lin Z W, Ding Q L, Huang J H, Tu W H, Hu D and Liu J F. 2019. Study on tree species classification of UAV optical image based on DenseNet. Remote Sensing Technology and Application, 34(4): 704-711
  18. 18.
    Liu Q, Wu Y and He H. 2001. Ecological problems of subalpine coniferous forest in the southwest of China. World Sci-Tech R and D, 23(2): 63-69
  19. 19.
    Liu Q W, Li S M, Li Z Y, Fu L Y and Hu K L. 2017. Review on the applications of UAV-Based LiDAR and photogrammetry in forestry. Scientia Silvae Sinicae, 53(7): 134-148
  20. 20.
    Maes W H and Steppe K. 2019. Perspectives for remote sensing with unmanned aerial vehicles in precision agriculture. Trends in Plant Science, 24(2): 152-164
  21. 21.
    Natesan S, Armenakis C and Vepakomma U. 2019. Resnet-based tree species classification using uav images. The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, XLII-2-W13: 475-481
  22. 22.
    Pajares G. 2015. Overview and current status of remote sensing applications based on unmanned aerial vehicles (UAVs). Photogrammetric Engineering and Remote Sensing, 81(4): 281-330
  23. 23.
    Ronneberger O, Fischer P and Brox T. 2015. U-Net: convolutional networks for biomedical image segmentation//18th International Conference on Medical Image Computing and Computer-Assisted Intervention. Munich: Springer: 234-241
  24. 24.
    Schiefer F, Kattenborn T, Frick A, Frey J, Schall P, Koch B and Schmidtlein S. 2020. Mapping forest tree species in high resolution UAV-based RGB-imagery by means of convolutional neural networks. ISPRS Journal of Photogrammetry and Remote Sensing, 170: 205-215
  25. 25.
    Trier Ø D, Salberg A B, Kermit M, Rudjord Ø, Gobakken T, Næsset E and Aarsten D. 2018. Tree species classification in Norway from airborne hyperspectral and airborne laser scanning data. European Journal of Remote Sensing, 51(1): 336-351
  26. 26.
    Wang J, Zhang C, Chen Q, Li H Y, Peng X, Bai M X, Xu Z Y, Liu H D and Chen Y F. 2022. The method of extracting information of cunninghamia lanceolata crown combined with RGB and LiDAR based on UAV. Journal of Southwest Forestry University (Natural Sciences), 42(1): 133-141
  27. 27.
    Wang X Q, Wang M M, Wang S Q and Wu Y D. 2015. Extraction of vegetation information from visible unmanned aerial vehicle images. Transactions of the Chinese Society of Agricultural Engineering, 31(5): 152-159
  28. 28.
    Wang Y, He C, Liu B L and Li S S. 2022. Single wood parameters extraction and DBH model construction based on UAV tilt photography technology. Journal of Southwest Forestry University, 42(1): 166-173
  29. 29.
    Xu Y, Zhang C L, Jiang R J, Wang Z F, Zhu M C and Shen G C. 2021. UAV-based hyperspectral images and monitoring of canopy tree diversity. Biodiversity Science, 29(5): 647-660
  30. 30.
    Zhang B, Zhao L and Zhang X L. 2020a. Three-dimensional convolutional neural network model for tree species classification using airborne hyperspectral images. Remote Sensing of Environment, 247: 111938
  31. 31.
    Zhang C, Atkinson P M, George C, Wen Z F, Diazgranados M and Gerard F. 2020b. Identifying and mapping individual plants in a highly diverse high-elevation ecosystem using UAV imagery and deep learning. ISPRS Journal of Photogrammetry and Remote Sensing, 169: 280-291
  32. 32.
    Zhang C, Xia K, Feng H L, Yang Y H and Du X C. 2021. Tree species classification using deep learning and RGB optical images obtained by an unmanned aerial vehicle. Journal of Forestry Research, 32(5): 1879-1888
  33. 33.
    Zheng J P, Fu H H, Li W J, Wu W Z, Yu L, Yuan S, Tao W Y W, Pang T K and Kanniah K D. 2021. Growing status observation for oil palm trees using Unmanned Aerial Vehicle (UAV) images. ISPRS Journal of Photogrammetry and Remote Sensing, 173: 95-121
  34. 34.
    Zhu W Z, Sheng Z L, Shu S M, Wang W W and Li X. 2021. Comprehensive evaluation of ecological function restoration of the natural secondary forests in a subalpine region of western Sichuan. Chinese Journal of Applied and Environmental Biology, 27(3): 694-704

Lesen Sie die ganze Passage

The above content is generated by Large Model Translation. The translated content is for reference only. We do not assume any commercial or legal responsibilty for any consequences arising from the use of our website