Review of the light-weighted and small UAV system for aerial photography and remote sensing

  • role: First author第一作者
  • Affiliation:

    School of Environment Science and Spatial Informatics, China University of Mining and Technology, Xuzhou 221116, China

    National Quality Inspection and Testing Center for Surveying and Mapping Products, Beijing 100830, China

  • Email:zhangjx@casm.ac.cn
  • Introduction:1965,,E-mail: zhangjx@casm.ac.cn
ZHANG Jixian12,  
  • Affiliation:

    School of Environment Science and Spatial Informatics, China University of Mining and Technology, Xuzhou 221116, China

LIU Fei1,  
  • Affiliation:

    School of Geomatics and Urban Spatial Informatics, Beijing University of Civil Engineering and Architecture, Beijing 100044, China

WANG Jian3

ملخص

Geospatial information is important in the era of artificial intelligence and big data. Small, lightweight unmanned aerial vehicles (UAVs) for aerial photogrammetry and Remote Sensing (RS) technology, as the main means of obtaining centimeter-scale resolution and real-time remote sensing data, may be expected to play an important role in these fields.First, this paper focuses on the development status and trends of UAV aerial photogrammetry and RS systems. Fixed-wing, lightweight, and small UAVs are an early type of aircraft in the field of surveying and mapping. The hand-throwing and vertical take-off and landing characteristics of fixed-wing UAV systems have prompted the development of these technologies toward the intelligent direction. Multi-rotor UAVs are important instruments in remote sensing mapping, but their flight duration requires further improvement. Unmanned helicopters are widely used in the remote sensing mapping of heavy loads, but this technology is greatly affected by cost, control complexity, and other factors. Digital camera, video camera, tilt camera, lidar, SAR, POS, and other loads are highly useful in surveying and mapping; however, because the detection and calibration of new sensors and UAV systems has not been optimized, the development of new technologies and equipment is limited to a certain extent.Next, the problems and challenges of system detection, large-scale real-time remote sensing, and accurate big data interpretation of UAV aerial photogrammetry and RS data are summarized and analyzed. UAV aerial photogrammetry and RS systems are widely used, but the detection methods and standards of UAV systems aimed at environmental adaptability, flight performance, navigation control accuracy, and electromagnetic compatibility have not been perfected. The real-time multi-level transmission technology of video, imagery, and other surveying and mapping data must be further developed for emergency rescue. The data obtained each year by UAV aerial photogrammetry and RS are more than PB and mostly used to produce standard surveying and mapping products. However, the data collected are insufficient for data mining and analysis.Finally, facing the technical backgrounds of artificial intelligence, big data, Internet of things, and cloud computing, among others, future development directions of intelligent flight control, UAV operation, and real-time, real-scene UAV remote sensing technologies are provided. The continuous development and improvement of the industry and rapid promotion of market demands, aerial photogrammetry, and RS technology of lightweight and small UAVs may be expected to promote industrial changes in earth observation and accurate public perception, potentially forming a new industry worth over 100 billion US dollars.

مفهوم

light-weighted and small UAV for aerial photogrammetry and RS;aerial photogrammetry and RS sensors;artificial intelligence;big data

References

  1. 1.
    An J H. 2018. APP Development of Single Lens UAV Tilt Image Acquisition Route Planning. Beijing: China University of Geosciences (Beijing) (安江航. 2018. 单镜头无人机倾斜影像采集航线规划APP研发. 北京: 中国地质大学(北京)
  2. 2.
    Anders N, Masselink R, Keesstra S and Suomalainen J. 2013. High-res digital surface modeling using fixed-wing UAV-based photogrammetry//Proceedings of Geomorphometry. Nanjing, China: [s.
  3. 3.
    Arnold T, de Biasio M, Fritz A, Frank A and Leitner R. 2012. UAV-based multi-spectral environmental monitoring. Sensors, 2010 IEEE, Waikoloa, HI, USA, 2010, pp. 995-998, doi: .
  4. 4.
    Ben L L and Wang P. 2018. Analysis on the application of unmanned helicopter in the field of aeronautical surveying and mapping. Dual Use Technologies and Products, (21): 64-66
  5. 5.
    Bi K, Li Y C, Ding X B and Liu F. 2015. Aerial photogrammetric technology of light small UAV: status and trend of development. Bulletin of Surveying and Mapping, (3): 27-31, 48
  6. 6.
    Bi K, Zhao J X, Ding X B and Liu F. 2017. Technical design and product quality inspection of oblique aerial photography. Bulletin of Surveying and Mapping, (4): 71-76
  7. 7.
    Chen S. 2006. Chinese Digital Camera Industry Market Structure and National Digital Camera Development Research. Fuzhou: Fuzhou University
  8. 8.
    Chen T E, Nagai M and Shibasaki R. 2012. An unmanned helicopter based mapping system with differential GPS and multi-Sensor. Science of Surveying and Mapping, 37(1): 158-160, 184
  9. 9.
    Chen X. 2018. Research on multi-objective route planning and task allocation algorithm for UAVs. Nanjing: Nanjing University
  10. 10.
    Cherkasov S, Farkhutdinov A, Rykovanov D P and Shaipov A A. 2018. The use of unmanned aerial vehicle for geothermal exploitation monitoring: khankala field example. Journal of Sustainable Development of Energy, Water and Environment Systems, 6(2): 351-362
  11. 11.
    Chiang K W, Tsai M L and Chu C H. 2012. The development of an UAV borne direct georeferenced photogrammetric platform for ground control point free applications. Sensors, 12(7): 9161-9180
  12. 12.
    Colomina I and Molina P. 2014. Unmanned aerial systems for photogrammetry and remote sensing: a review. ISPRS Journal of Photogrammetry and Remote Sensing, 92: 79-97
  13. 13.
    Cress J J, Hutt M E, Sloan J L, Bauer M A, Feller M R and Goplen S E. 2015. U.S. Geological survey Unmanned Aircraft Systems (UAS) Roadmap 2014. Reston, VA, U.S. Geological Survey
  14. 14.
    Cui H X, Sun J, Lin Z J and Chu M H. 2005. Research on calibration of the non-measurement camera. Science of Surveying and Mapping, 30(1): 105-107
  15. 15.
    Ding M, Tang L, Zhou L L, Wang X M, Weng Z L and Qu J M. 2019. W band mini-SAR on multi rotor UAV platform//Proceedings of the 2019 IEEE 2nd International Conference on Electronic Information and Communication Technology. Harbin, China: IEEE: 416-418
  16. 16.
    Dong X Y, Li J G, Chen H Y, Zhao L, Zhang L M and Xing S H. 2019. Extraction of individual tree information based on remote sensing images from an Unmanned Aerial Vehicle. Journal of Remote Sensing, 23(6): 1269-1280
  17. 17.
    Editorial Board of the Documentary of Western China Mapping Project. 2012. The Documentary of Western China Mapping Project. Beijing: China Society Press (《西部测图工程纪实》编委会. 2012. 西部测图工程纪实. 北京: 中国社会出版社)
  18. 18.
    Edrich M and Weiss G. 2008. Second-generation Ka-band UAV SAR system//Proceedings of the 2008 38th European Microwave Conference. Amsterdam, Netherlands: IEEE: 1636-1639
  19. 19.
    Essen H, Johannes W, Stanko S, Sommer R, Wahlen A and Wilcke J. 2012. High resolution W-band UAV SAR//Proceedings of 2012 IEEE International Geoscience and Remote Sensing Symposium. Munich, Germany: IEEE: 5033-5036
  20. 20.
    Eugster H and Nebiker S. 2008. UAV-based augmented monitoring-real-time georeferencing and integration of video imagery with virtual globes. IAPRSSIS, 2008, 37(B1): 1229-1235
  21. 21.
    Frey O, Werner C L and Coscione R. 2019. Car-borne and UAV-borne mobile mapping of surface displacements with a compact repeat-pass interferometric SAR system at L-band//Proceedings of 2019 IEEE International Geoscience and Remote Sensing Symposium. Yokohama, Japan: IEEE: 274-277
  22. 22.
    Frost and Sullivan. 2007. Study analysing the current activities in the field of UAV. ENTR/2007/065. 2007. Available online: .
  23. 23.
    General Administration of Quality Supervision, Inspection and Quarantine of the People’s Republic of China and Standardization Administration of China. 2012. GB/T 27919-2011 Specifications for IMU/GPS supported aerial photography. Beijing: Standards Press of China
  24. 24.
    Gonzalo P. 2015. Overview and current status of remote sensing applications based on Unmanned Aerial Vehicles (UAVs). Photogrammetric Engineering and Remote Sensing, 81(4): 281-330
  25. 25.
    Grenzdörffer G, Niemeyer F and Schmidt F. 2012. Development of four vision camera system for a micro-UAV//Proceedings of XXII ISPRS Congress. Melbourne, Australia: International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences: 369-374
  26. 26.
    Guo D H, Wang J C and Zheng X W. 2009. Theory and Practice of Direct Geographic Positioning Technology in Airborne POS System. Beijing: Geological Publishing House
  27. 27.
    Guo D H, Wu L X, Wang J C and Zheng X W. 2004. A preliminary discussion on direct georeferencing of integrated GPS/IMU. Remote Sensing for Land and Resources, 16(2): 26-31
  28. 28.
    Guo H D. 2000. Radar for Earth Observation. Beijing: Science Press
  29. 29.
    Gupta S G, Ghonge M and Jawandhiya P M. 2013. Review of unmanned aircraft system (UAS). International Journal of Advanced Research in Computer Engineering and Technology, 2(4): 1646-1658
  30. 30.
    Han H Z and Wang J. 2017. Robust GPS/BDS/INS tightly coupled integration with atmospheric constraints for long-range kinematic positioning. GPS Solutions, 21(3): 1285-1299
  31. 31.
    Han H Z, Wang J, Wang J L and Tan X L. 2015. Performance analysis on carrier phase-based tightly-coupled GPS/BDS/INS integration in GNSS degraded and denied environments. Sensors, 15(4): 8685-8711
  32. 32.
    Hawkins B P and Tung W. 2019. UAVSAR real-time embedded GPU processor//Proceedings of 2019 IEEE International Geoscience and Remote Sensing Symposium. Yokohama, Japan: IEEE: 545-547
  33. 33.
    Hk W. 2017. AV500 completes the demonstration of “Aviation Emergency Mapping system for Unmanned helicopter”. Dual Use Technologies and Products, (7): 18
  34. 34.
    Jayathunga S, Owari T and Tsuyuki S. 2018. Evaluating the performance of photogrammetric products using fixed-wing UAV imagery over a mixed conifer–broadleaf forest: comparison with airborne laser scanning. Remote Sensing, 10(2): 187
  35. 35.
    Jiang Y Z, Liu Y, Han Z H and Yang J. 1992. The development and present situation of foreign small format aerial remote sensing. Surveying and Mapping of Sichuan, (3): 106-110
  36. 36.
    Li D R. 2013. New mission for surveying, mapping and geomatics in smart earth Era. China Surveying and Mapping, (1): 6-7 (李德仁. 2013. 智慧地球时代测绘地理信息学的新使命. 中国测绘, (1): 32-33)
  37. 37.
    Li D R. 2016. Towards geo-spatial information science in big data era. Acta Geodaetica et Cartographica Sinica, 45(4): 379-384
  38. 38.
    Li D R and Li M. 2014. Research advance and application prospect of unmanned aerial vehicle remote sensing system. Geomatics and Information Science of Wuhan University, 39(5): 505-513, 540
  39. 39.
    Li H Q. 2009. Accuracy Researche of Close-Range Photogrammetry Base on Non-Metric Digital Camera. Jiaozuo: Henan Polytechnic University
  40. 40.
    Li S W, Chen T F, Li L and Li X L. 2019. System design of tethered coaxial twin-rotor uav based on APM flight control technology. Electronics World, (11): 166-167
  41. 41.
    Li X Y. 2005. IMU/DGPS-supported Photogrammetry Theory, Approaches and Practice. Zhengzhou: Institute of Surveying and Mapping, Information Engineering University
  42. 42.
    Li Y. 2011. Research on Resources Allocation and Formation Trajectories Optimization for Multiple UAVs Cooperation Mission. Changsha: National University of Defense Technology
  43. 43.
    Li Y C, Liu F, Ding X B, Liu P, Luo X Y and Ren Y F. 2015. Method and device for determining exposure time of aerial photogrammetric camera in light-small unmanned aerial vehicle. CN, CN201510178178.
  44. 44.
    Li Y C, Liu F, Ding X B, Yang J J, Ren Y F and Liu P. 2017. Multi-view stereo aerial photographic device for unmanned aerial vehicles and method for determining focal length of multi-view stereo aerial photographic device. CN, CN201510178317.9
  45. 45.
    Li Y C, Wang F, Liu P, Sun X B and Liu F. 2018. Method and device for fusing video data and geographic position information. CN, CN201610055522.0
  46. 46.
    Li Y C, Ye D M, Xue Y L and Li T H. 2012. Application of GPS supported aerial triangulation technology in UAV island topographic mapping. Science of Surveying and Mapping, 37(5): 55-57
  47. 47.
    Liang F L. 2013. Research on Enhanced Imaging Techniques of Low-altitude UAV-Mounted UWB SAR. Changsha: National University of Defense Technology
  48. 48.
    Liao X H and Zhou C G. 2016. Development Report on Remote Sensing of Light and Small UAV. Beijing: Science Press
  49. 49.
    Liu L and Ji B. 2014. Status and development of radar on UAV. Modern Navigation, 5(3): 227-231
  50. 50.
    Liu R K and Zhang X L. 2000. High speed data downlink of airborne SAR in the pilotless aircraft. Journal of Telemetry, Tracking, and Command, 21(3): 19-23
  51. 51.
    Liu Y S, Qin X, Guo W Q, Gao S R, Chen J Z, Wang L H, Li Y Z and Jin Z Z. 2020. Influence of the use of photogrammetric measurement precision on low-altitude micro-UAVs in the glacier region. Journal of Remote Sensing, 24(2): 161-172
  52. 52.
    López J, Dormido R, Dormido S and Gómez J P. 2015. A robust H controller for an UAV flight control system. The Scientific World Journal, 2015: 403236
  53. 53.
    Luo X. 2019. Research on Route Planning of UAV Power Inspection Based on Fish Swarm Algorithm. Nanchang: Nanchang University
  54. 54.
    Merz T and Chapman S. 2011. Autonomous unmanned helicopter system for remote sensing missions in unknown environments//Proceedings of ISPRS Zurich 2011 Workshop. Zurich, Switzerland: International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences: 143-148
  55. 55.
    Mian O, Lutes J, Lipa G, Hutton J J, Gavelle E and Borghini S. 2016. Accuracy assessment of direct georeferencing for photogrammetric applications on small unmanned aerial platforms//Proceedings of European Calibration and Orientation Workshop. Lausanne, Switzerland: International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences: 77-83
  56. 56.
    Niethammer U, James M R, Rothmund S, Travelletti J and Joswig M. 2012. UAV-based remote sensing of the Super-Sauze landslide: evaluation and results. Engineering Geology, 128: 2-11
  57. 57.
    Pastor E, Lopez J and Royo P. 2007. UAV payload and mission control hardware/software architecture. IEEE Aerospace and Electronic Systems Magazine, 22(6): 3-8
  58. 58.
    Peng Z B. 2018. Design and Implementation of UAV Real-time HD Image Transmission System. Xi’an: Xidian University
  59. 59.
    Remondino F, Barazzetti L, Nex F, Scaioni M and Sarazzi D. 2011. UAV photogrammetry for mapping and 3D modeling–current status and future perspectives//Proceedings of ISPRS Zurich 2011 Workshop. Zurich, Switzerland: International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences: 25-31
  60. 60.
    Remy M A, de Macedo K A C and Moreira J R. 2012. The first UAV-based P- and X-band interferometric SAR system//Proceedings of 2012 IEEE International Geoscience and Remote Sensing Symposium. Munich, Germany: IEEE: 5041-5044
  61. 61.
    Ren C F. 2014. Research on Key Technologies of DOM Generation by Aerial Video. Wuhan: Wuhan University
  62. 62.
    Routescene. 2019. Technical specification for your turnkey UAV LiDAR solution[EB/OL].)
  63. 63.
    Sancı S and İşler V. 2011. A parallel algorithm for UAV flight route planning on GPU. International Journal of Parallel Programming, 39(6): 809-837
  64. 64.
    Saur G and Krüger W. 2016. Change detection in uav video mosaics combining a feature based approach and extended image differencing//Proceedings of XXIII ISPRS Congress. Prague, Czech Republic: International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences: 557-562
  65. 65.
    School of Geodesy and Geomatics of Wuhan University. 2019. UAV lidar can measure shallow water depth[EB/OL]. [2019-11-26].
  66. 66.
    Shan Y. 2018. Research on Autonomous Landing Control of Quadrotor UAV Based on Vision-guiding. Nanjing: Nanjing University of Aeronautics and Astronautics
  67. 67.
    State Bureau of Surveying and Mapping. 2010a. CH/Z 3003-2010
  68. 68.
    低空数字航空摄影测量内业规范. 北京: 测绘出版社)
  69. 69.
    State Bureau of Surveying and Mapping. 2010. CH/Z 3004-2010
  70. 70.
    低空数字航空摄影测量外业规范. 北京: 测绘出版社)
  71. 71.
    Sujit P B, Hudzietz B P and Saripalli S. 2013. Route planning for angle constrained terrain mapping using an unmanned aerial vehicle. Journal of Intelligent and Robotic Systems, 69(1/4): 273-283
  72. 72.
    Sun X B, Li Y C, Wang F, Liu F, Wang S X and Zhou G W. 2018. Design and implementation of UAV geographic information video system. Science of Surveying and Mapping, 43(10): 131-136, 156
  73. 73.
    Tian Y, Zou C H, Zhou Z W and Zhou X D. 2016. Development and application of multi-rotor UAV (part two). Model Airplane, (2): 84-87
  74. 74.
    Wallace L, Lucieer A, Watson C and Turner D. 2012. Development of a UAV-LiDAR system with application to forest inventory. Remote Sensing, 4(6): 1519-1543
  75. 75.
    Wan Y L, Zhang L L, Lu S Z, Xu J and Chen P T. 2018. Design of obstacle avoidance flight system based on PX4 flight control UAV. Practical Electronics, (13): 31-33
  76. 76.
    Wang H and Xu G H. 2003. Research status and Development trend of unmanned helicopter. Helicopter Technique, (2): 45-49
  77. 77.
    Watts A C, Ambrosia V G and Hinkley E A. 2012. Unmanned aircraft systems in remote sensing and scientific research: classification and considerations of use. Remote Sensing, 4(6): 1671-1692
  78. 78.
    Whitehead K, hugenholtz C H, Myshak S, Brown O, LeClair A, Tamminga A, Barchyn T E, Moorman B and Eaton B. 2014. Remote sensing of the environment with small unmanned aircraft systems (UASs), Part 2: scientific and commercial applications. Journal of Unmanned Vehicle Systems, 2(3): 86-102
  79. 79.
    Xue L. 2016. Design and Implementation of Flight Control System of Unmanned Multi-Rotor Aircraft. Nanjing: Nanjing University of Aeronautics and Astronautics
  80. 80.
    Xue W. 2014. The Calibration of UAV Video Geo-Information and Live Processing Technology. Zhengzhou: PLA Information Engineering University
  81. 81.
    Xue W, Zhang Y S, Wang T, Yu Y and Cao B C. 2019. High precision positioning of unmanned helicopter with area array images. Geomatics and Information Science of Wuhan University, 44(2): 246-253
  82. 82.
    Yamazaki F and Wen L. 2016. Remote sensing technologies for post-earthquake damage assessment: a case study on the 2016 kumamoto earthquake//Proceedings of 6th ASIA Conference on Earthquake Engineering. Cebu City, Philippines: 1-13
  83. 83.
    Yan L, Liao X H, Zhou C H, Fan B K, Gong J Y, Cui P, Zheng Y Q and Tan X. 2019. The impact of UAV remote sensing technology on the industrial development of China: a review. Journal of Geo-information Science, 21(4): 475-495
  84. 84.
    Yang B S and Li J P. 2018. Implementation of a low-cost mini-UAV laser scanning system. Geomatics and Information Science of Wuhan University, 43(12): 1972-1978
  85. 85.
    Yang M L, Li D C, Wan Z Q, Yan D and Wang Y K. 2019. Current status and application prospect analysis of VTOL-UAVs for remote sensing applications in China. Journal of Geo-information Science, 21(4): 496-503
  86. 86.
    Yang R J. 2015. Research of Hybrid Redundancy Flight Control Computer Kernel of UAV Based on X86 and PowerPC. Nanjing: Nanjing University of Aeronautics and Astronautics
  87. 87.
    Yang Y X, Li J L, Wang A B, Xu J Y, He H B, Guo H R, Shen J F and Dai X. 2014. Preliminary assessment of the navigation and positioning performance of BeiDou regional navigation satellite system. Science China Earth Sciences, 57(1): 144-152
  88. 88.
    Yang Y X, Xu Y Y, Li J L and Yang C. 2018. Progress and performance evaluation of BeiDou global navigation satellite system: data analysis based on BDS-3 demonstration system. Science China Earth Sciences, 61(5): 614-624
  89. 89.
    Yao H, Qin R J and Chen X Y. 2019. Unmanned aerial vehicle for remote sensing applications—A review. Remote Sensing, 11(12): 1443
  90. 90.
    Yi J B, Li X H and Sun H L. 1994. The investigation of technical requirements for small format aerial photograghy. Geomatics and Information Science of Wuhan University, 19(2): 113-117
  91. 91.
    Yuan X X. 2001. Principle and Application of GPS-aided aerial Triangulation. Beijing: Surveying and Mapping Press
  92. 92.
    Yuan X X. 2008. POS-supported bundle block adjustment. Acta Geodaetica et Cartographica Sinica, 37(3): 342-348
  93. 93.
    Yuan X X, Fu J H, Zuo Z L and Sun H X. 2006. Accuracy analysis of direct georeferencing by airborne position and orientation system in aerial photogrammetry. Geomatics and Information Science of Wuhan University, 31(10): 847-850
  94. 94.
    Zhang J X, Lin X G and Liang X L. 2017. Advances and prospects of information extraction from point clouds. Acta Geodaetica et Cartographica Sinica, 46(10): 1460-1469
  95. 95.
    Zhang J X, Yan Q and Zhang L. 2013. Principle and Methodology of Western China Topographic Mapping. Beijing: Surveying and Mapping Press
  96. 96.
    Zhang X X, Wang S T, Li Y C, Liu F, Ding X B and Ren Y F. 2019. Accuracy analysis of aerial small UAV flight control attitude data. Science of Surveying and Mapping, 44(5): 102-109
  97. 97.
    Zhang Z. 2000. A flexible new technique for camera calibration. IEEE Transactions on Pattern Analysis and Machine Intelligence, 22(11): 1330-1334
  98. 98.
    Zhao J L and Wang S. 2017. Comparative analysis of 3D modeling based on dual cameras and five camerasoblique photograph. Bulletin of Surveying and Mapping, (S1): 18-21, 29
  99. 99.
    Zhou G Q. 2009. Near real-time orthorectification and mosaic of small UAV video flow for time-critical event response. IEEE Transactions on Geoscience and Remote Sensing, 47(3): 739-747
  100. 100.
    Zhu X K. 2018. Research on Key Technologies and Applications of 1: 500
  101. 101.
    无人机大比例尺测图关键技术及应用研究. 武汉: 武汉大学)
  102. 102.
    Zulu A and John S. 2014. A review of control algorithms for autonomous quadrotors. Open Journal of Applied Sciences, 4(14): 547-556

قراءة النص الكامل

The above content is generated by Large Model Translation. The translated content is for reference only. We do not assume any commercial or legal responsibilty for any consequences arising from the use of our website