سابِق|تال

Urban individual tree crown detection research using multispectral image dimensionality reduction with deep learning

  • role： First author第一作者
  • Affiliation：

    College of Mathematics and Computer Science, Zhejiang Agriculture and Forestry University, Hangzhou 311300, China

    Zhejiang Provincial Key Laboratory of Forestry Intelligent Monitoring and Information Technology, Hangzhou 311300, China

    Key Laboratory of Forestry Perception Technology and Intelligent Equipment, State Forestry Administration, Hangzhou 311300, China

  • Email：xixiangshu704@foxmail.com
  • Introduction：奚祥书， 研究方向为林业信息化。E-mail： xixiangshu704@foxmail.com
XI Xiangshu,  
  • role： Corresponding author通信作者
  • Affiliation：

    College of Mathematics and Computer Science, Zhejiang Agriculture and Forestry University, Hangzhou 311300, China

    Zhejiang Provincial Key Laboratory of Forestry Intelligent Monitoring and Information Technology, Hangzhou 311300, China

    Key Laboratory of Forestry Perception Technology and Intelligent Equipment, State Forestry Administration, Hangzhou 311300, China

  • Email：xiakai@zafu.edu.cn
  • Introduction：夏凯，研究方向为机器学习，遥感，林业信息化。E-mail： xiakai@zafu.edu.cn
XIA Kai*,  
  • Affiliation：

    College of Mathematics and Computer Science, Zhejiang Agriculture and Forestry University, Hangzhou 311300, China

    Zhejiang Provincial Key Laboratory of Forestry Intelligent Monitoring and Information Technology, Hangzhou 311300, China

    Key Laboratory of Forestry Perception Technology and Intelligent Equipment, State Forestry Administration, Hangzhou 311300, China

YANG Yinhui,  
  • Affiliation：

    College of Mathematics and Computer Science, Zhejiang Agriculture and Forestry University, Hangzhou 311300, China

    Zhejiang Provincial Key Laboratory of Forestry Intelligent Monitoring and Information Technology, Hangzhou 311300, China

    Key Laboratory of Forestry Perception Technology and Intelligent Equipment, State Forestry Administration, Hangzhou 311300, China

DU Xiaochen,  
  • Affiliation：

    College of Mathematics and Computer Science, Zhejiang Agriculture and Forestry University, Hangzhou 311300, China

    Zhejiang Provincial Key Laboratory of Forestry Intelligent Monitoring and Information Technology, Hangzhou 311300, China

    Key Laboratory of Forestry Perception Technology and Intelligent Equipment, State Forestry Administration, Hangzhou 311300, China

FENG Hailin

ملخص

The dimensionality reduction processing of multispectral data is of considerable importance to deep learning-based single-tree crown detection research. However, how to use the appropriate dimensionality reduction method to improve the accuracy of single-tree detection is rarely discussed. In this work, an unmanned aerial vehicle equipped with a multispectral camera was used for aerial photography to collect multispectral images of ginkgo tree species in the research area. The original multispectral images were used to generate five different data sets through feature band selection, feature extraction, and band combination method for training three classical deep learning networks: FPN-Faster-R-CNN, YOLOv3, and Faster R-CNN. Based on the characteristics of the band selection method, the red, green, and near-infrared bands combined with different types of target detection in the network have the best results. The FPN-Faster-R-CNN network detection accuracy is up to 88.4% for ginkgo trees. The blue, red, and near-infrared band combination obtained by the OIF index has the highest amount of information but the lowest average network accuracy at 79.3%. Experimental results show the following. In the different dimensionality reduction methods, if the color and background of the target object in the image after dimensionality reduction are obviously different, and the contour is clear, the deep learning network can obtain better results in tree crown detection. However, the information content of the image itself has a limited effect on the ability of the deep learning network to detect tree crowns. In this study, the dimensionality reduction method of multispectral images is analyzed, providing an important experimental reference for the deep learning-based single-tree crown detection.

مفهوم

remote sensing;individual tree crown detection;deep learning;unmanned aerial vehicle;multispectral images;dimensionality reduction

References

  1. 1.
    Ampatzidis Y and Partel V. 2019. UAV-based high throughput phenotyping in citrus utilizing multispectral imaging and artificial intelligence. Remote Sensing, 11(4): 410
  2. 2.
    Bunting P and Lucas R. 2006. The delineation of tree crowns in Australian mixed species forests using hyperspectral Compact Airborne Spectrographic Imager (CASI) data. Remote Sensing of Environment, 101(2): 230-248
  3. 3.
    Chavez Jr P S, Berlin G L and Sowers L B. 1982. Statistical method for selecting Landsat MSS Ratios. Journal of Applied Photographic Engineering, 8(1): 23-30.
  4. 4.
    Cui B G, Wu Y N, Zhong Y, Zhong L W and Lu Y. 2019. Hyperspectral image rolling guidance recursive filtering and classification. Journal of Remote Sensing, 23(3): 431-442
  5. 5.
    Dai W X, Yang B S, Dong Z and Shaker A. 2018. A new method for 3D individual tree extraction using multispectral airborne LiDAR point clouds. ISPRS Journal of Photogrammetry and Remote Sensing, 144: 400-411
  6. 6.
    Dong X Y, Li J G, Chen H Y, Zhao L, Zhang L M and Xing S H. 2019. Extraction of individual tree information based on remote sensing images from an Unmanned Aerial Vehicle. Journal of Remote Sensing, 23(6): 1269-1280
  7. 7.
    Feng J J, Liu H L and Zhang X L. 2017. Single tree crown extraction based on gray gradient image segmentation. Journal of Beijing Forestry University, 39(3): 16-23
  8. 8.
    Gougeon F A. 1995. A crown-following approach to the automatic delineation of individual tree crowns in high spatial resolution aerial images. Canadian Journal of Remote Sensing, 21(3): 274-284
  9. 9.
    Ke Y and Quackenbush L J. 2011. A review of methods for automatic individual tree-crown detection and delineation from passive remote sensing. International Journal of Remote Sensing, 32(17): 4725-4747
  10. 10.
    Kellenberger B, Marcos D and Tuia D. 2018. Detecting mammals in UAV images: best practices to address a substantially imbalanced dataset with deep learning. Remote Sensing of Environment, 216: 139-153
  11. 11.
    Korpela I, Anttila P and Pitkänen J. 2006. The performance of a local maxima method for detecting individual tree tops in aerial photographs. International Journal of Remote Sensing, 27(6): 1159-1175
  12. 12.
    Lee J H, Ko Y and McPherson E G. 2016. The feasibility of remotely sensed data to estimate urban tree dimensions and biomass. Urban Forestry and Urban Greening, 16: 208-220
  13. 13.
    Li D, Zhang J J and Zhao M X. 2019. Extraction of stand factors in UAV image based on FCM and watershed algorithm. Scientia Silvae Sinicae, 55(5): 181-187
  14. 14.
    Lin T Y, Dollár P, Girshick R, He K M, Hariharan B and Belongie S. 2017. Feature pyramid networks for object detection//Proceedings of 2017 IEEE Conference on Computer Vision and Pattern Recognition. Honolulu, HI, USA: IEEE: 936-944
  15. 15.
    Liu X S, Ge L, Wang B and Zhang L M. 2012. An unsupervised band selection algorithm for hyperspectral imagery based on maximal information. Journal of Infrared and Millimeter Waves, 31(2): 166-170, 176
  16. 16.
    Majeed Y, Zhang J, Zhang X, Fu L S, Karkee M, Zhang Q and Whiting M D. 2020. Deep learning based segmentation for automated training of apple trees on trellis wires. Computers and Electronics in Agriculture, 170: 105277
  17. 17.
    Mozgeris G, Juodkienė V, Jonikavičius D, Straigytė L, Gadal S and Ouerghemmi W. 2018. Ultra-light aircraft-based hyperspectral and colour-infrared imaging to identify deciduous tree species in an urban environment. Remote Sensing, 10(10): 1668
  18. 18.
    Osco L P, dos Santos de Arruda M, Marcato Junior J, da Silva N B, Ramos A P M, Moryia É A S, Imai N N, Pereira D R, Creste J E, Matsubara E T, Li J and Gonçalves W N. 2020. A convolutional neural network approach for counting and geolocating citrus-trees in UAV multispectral imagery. ISPRS Journal of Photogrammetry and Remote Sensing, 160: 97-106
  19. 19.
    Pan S J and Yang Q. 2010. A survey on transfer learning. IEEE Transactions on Knowledge and Data Engineering, 22(10): 1345-1359
  20. 20.
    Puliti S, Solberg S and Granhus A. 2019. Use of UAV photogrammetric data for estimation of biophysical properties in forest stands under regeneration. Remote Sensing, 11(3): 233
  21. 21.
    Redmon J and Farhadi A. 2018. YOLOv3: An incremental improvement. [2019.12.1]. .
  22. 22.
    Ren S Q, He K M, Girshick R and Sun J. 2017. Faster R-CNN: towards real-time object detection with region proposal networks. IEEE Transactions on Pattern Analysis and Machine Intelligence, 39(6): 1137-1149
  23. 23.
    Roth S I B, Leiterer R, Volpi M, Celio E, Schaepman M E and Joerg P C. 2019. Automated detection of individual clove trees for yield quantification in northeastern Madagascar based on multi-spectral satellite data. Remote Sensing of Environment, 221: 144-156
  24. 24.
    Wang J M, Chen X X, Cao L, An F, Chen B Q, Xue L F and Yun T. 2019. Individual rubber tree segmentation based on ground-based LiDAR data and faster R-CNN of deep learning. Forests, 10(9): 793
  25. 25.
    Weinstein B G, Marconi S, Bohlman S, Zare A and White E. 2019. Individual tree-crown detection in RGB imagery using Semi-supervised deep learning neural networks. Remote Sensing, 11(11): 1309
  26. 26.
    Weinstein B G, Marconi S, Bohlman S A, Zare A and White E P. 2020. Cross-site learning in deep learning RGB tree crown detection. Ecological Informatics, 56: 101061
  27. 27.
    Wold S, Esbensen K and Geladi P. 1987. Principal component analysis. Chemometrics and Intelligent Laboratory Systems, 2(1/3): 37-52
  28. 28.
    Wu X W, Sahoo D and Hoi S C H. 2020. Recent advances in deep learning for object detection. Neurocomputing, 396: 39-64
  29. 29.
    Zhao Q Z, Liu W, Yin X J and Zhang T Y. 2016. Selection of optimum bands combination based on multispectral images of UAV. Transactions of the Chinese Society for Agricultural Machinery, 47(3): 242-248, 291
  30. 30.
    Zhen Z, Quackenbush L J and Zhang L J. 2016. Trends in automatic individual tree crown detection and delineation-evolution of LiDAR data. Remote Sensing, 8(4): 333

قراءة النص الكامل

The above content is generated by Large Model Translation. The translated content is for reference only. We do not assume any commercial or legal responsibilty for any consequences arising from the use of our website