Development of high-resolution satellite ground processing system

  • role: First author第一作者
  • Affiliation:

    China Centre for Resources Satellite Data and Application, Beijing 100094, China

  • Email:wangbingbing@chinasiwei.com
  • Introduction:1965E-mail wangbingbing@chinasiwei.com
WANG Bingbing,  
  • role: Corresponding author通信作者
  • Affiliation:

    China Centre for Resources Satellite Data and Application, Beijing 100094, China

  • Email:yuwenyong@chinasiwei.com
  • Introduction:1978E-mail yuwenyong@chinasiwei.com
YU Wenyong*,  
  • Affiliation:

    China Centre for Resources Satellite Data and Application, Beijing 100094, China

LONG Xiaoxiang,  
  • Affiliation:

    China Centre for Resources Satellite Data and Application, Beijing 100094, China

LIN Jun,  
  • Affiliation:

    China Centre for Resources Satellite Data and Application, Beijing 100094, China

WANG Haibo,  
  • Affiliation:

    China Centre for Resources Satellite Data and Application, Beijing 100094, China

SONG Chaoyu,  
  • Affiliation:

    China Centre for Resources Satellite Data and Application, Beijing 100094, China

CHEN Qi,  
  • Affiliation:

    China Centre for Resources Satellite Data and Application, Beijing 100094, China

GE Shule,  
  • Affiliation:

    China Centre for Resources Satellite Data and Application, Beijing 100094, China

LI Shuai

реферат

The ground processing system of the high-resolution satellites is an important component of the high-resolution earth observation system. Following the principles of standardization, safety and reliability, maintainability, economy, and advanced technology, a remote sensing data comprehensive processing platform, which can realize the functions of data ingestion, multilevel standard data production, archiving, simulation, evaluation, distribution services, radiometric and geometric calibration, observation management of the payloads on GF-1 to GF-7 satellites, is designed and developed.The ground processing system adopts the cloud computing ground processing architecture based on the HADOOP platform and integrates the internal storage of nodes into a massive data storage system through the HDFS distributed file system. It also realizes the united scheduling and large-scale parallel processing of massive data through the Yarn resource management system. Moreover, it studies and develops the high-precision processing algorithms of the multispectral, hyper-spectral, infrared, microwave, Lidar, and atmosphere detection payloads on the satellites.The high-resolution satellite ground processing system builds a multisatellite comprehensive processing platform for massive satellite data. The capabilities of the ground processing system have been substantially improved in data integrated processing, data storage and management, and data distribution services; it provides standard data products to users with high accuracy and quality.It has 400 trillion calculations per second and highly automated data processing capacity of more than 20 TB per day. It can process a wide range of satellite payload types for GF-1 to GF-7 satellites. In the normal mode, the data processing time of each orbit is not more than 2 hours, and the emergency processing time is not more than 45 minutes.The system has 25 PB scalable storage and management capabilities of massive remote sensing image data. The products are stored online and near line within the life cycle, and level 0 data are permanently archived.For data distribution, the system can distribute more than four million scene data every year and supports 1000 external users to visit and retrieve the data on the service website at the same time. The average retrieval response time is less than 10 seconds. It also supports 200 external users to download data products online.The system has the continuous operation ability of 7×24 hours. The operation stability is better than 99%. The main and backup switches of the key business equipment are completed within 10 minutes after the failure. The mean time to repair is 4 hours.The high-resolution satellite ground processing system has realized satellite data ingestion, standard product processing, archiving, simulation, evaluation, distribution, calibration, payload management, and data sharing services. It has also realized the comprehensive data processing of a wide range of remote sensing data, which cover optical, submeter high spatial resolution, multimode radar, geosynchronous orbit, hyperspectral resolution, atmospheric, stereo mapping, and Lidar earth observation. A multisatellite and multiload remote sensing data product system have been established to provide multisource remote sensing data for land, ocean, agriculture, disaster reduction, forestry, water conservancy, environment, earthquake, meteorology, transportation, surveying, and mapping users. It has played an important role in promoting China’s economic construction, social development, scientific and technological progress, and serving China’s belt and road initiatives.

ключеви́че слова́

cloud computing;high-resolution satellite;ground processing system;remote sensing data processing

References

  1. 1.
    Arvidson R, Billingsley F, Chase R, Chavez Jr P, Devirian M and Mosher F. 1986. Earth observing system, volume IIa: data and information system, report of the EOS data panel[EB/OL]. [2020-08-25]
  2. 2.
    Chen L Y, Liang X D and Ding C B. 2010. Non-uniform reconstruction method in SAR imaging. Journal of System Simulation, 22(5): 1242-1245
  3. 3.
    Deng Y K, Jia X X, Feng J and Xu W. 2010. Sliding spotlight SAR data processing using the azimuth frequency de-ramping algorithm. Journal of Electronics and Information Technology, 32(11): 2655-2660
  4. 4.
    Esfandiari M, Ramapriyan H, Behnke J and Sofinowski E. 2006 Evolution of the Earth Observing System (EOS) Data and Information System (EOSDIS)//2006 IEEE International Symposium on Geoscience and Remote Sensing. Denver: IEEE: 309-312
  5. 5.
    Fan Q and Liu S L. 2011. Study on azimuth non-uniform sampling of spaceborne DPC MAB SAR. Journal of Test and Measurement Technology, 25(5): 406-413
  6. 6.
    Gu X F, Chen X F, Cheng T H, Li Z Q, Yu T, Xie D H and Xu H. 2011. In-flight polarization calibration methods of directional polarizedremote sensing camera DPC. Acta Physica Sinica, 60(7): 070702
  7. 7.
    Han B, Zhang Y J, Hu D H and Huang J L. 2011. Research on mending of space-borne sliding spotlight SAR imaging model error. Journal of Electronics and Information Technology, 33(7): 1694-1699
  8. 8.
    He F, Dong Z, Zhang Y S, Jin G H and Yu A X. 2020. Processing of spaceborne squinted sliding spotlight and HRWS TOPS mode data using 2-D baseband azimuth scaling. IEEE Transactions on Geoscience and Remote Sensing, 58(2): 938-955
  9. 9.
    Kobler B, Berbert J, Caulk P and Hariharan P C. 1995. Architecture and design of storage and data management for the NASA Earth observing system Data and Information System (EOSDIS)//Proceedings of IEEE 14th Symposium on Mass Storage Systems. Monterey: IEEE: 65-76
  10. 10.
    Li Y T, Chen Y G, Deng Y K and Yin C B. 2012. Data reconstruction method for azimuth multi-channel SAR. Journal of Electronics and Information Technology, 34(3): 628-632
  11. 11.
    Liu Y N, Sun D X, Cao K Q, Liu S F, Chai M Y, Liang J and Yuan J. 2020. Evaluation of GF-5 AHSI on-orbit instrument radiometric performance. Journal of Remote Sensing, 24(4): 352-359
  12. 12.
    Loghin V. 2017. Copernicus program of the European Union for environmental monitoring and civil security. Annals “Valahia” University of Targoviste-Agriculture, 11(1): 53-55
  13. 13.
    Redd N T. 2018. Earth observing system: monitoring the planet's climate[EB/OL]. Science and Astronomy, [2020-08-25]
  14. 14.
    Tang Y, Wang Y F and Zhang B C. 2007. A study of sliding spotlight SAR imaging mode. Journal of Electronics and Information Technology, 29(1): 26-29
  15. 15.
    Thépaut J N, Dee D, Engelen R and Pinty B. 2018. The copernicus programme and its climate change service//IGARSS 2018-2018 IEEE International Geoscience and Remote Sensing Symposium. Valencia: IEEE: 1591-1593
  16. 16.
    Zhang M M, Meng B H, Qian H H, Han L, Chen H J, Wang Y and Hong J. 2017. Research on correction method of stray light in directional polarization camera. Acta Optica Sinica, 37(11): 1112003
  17. 17.
    Zhou Y M and Liu T. 2021. The latest development in the field of foreign space earth observation. Satellite Application, (2): 47-53

Читать полностью

The above content is generated by Large Model Translation. The translated content is for reference only. We do not assume any commercial or legal responsibilty for any consequences arising from the use of our website