A new hyper-temporal imaging mode for spaceborne CMOS cameras

  • role: First author第一作者
  • Affiliation:

    Qian Xuesen Laboratory of Space Technology, China Academy of Space Technology, Beijing 100094, China

  • Email:lifeng@qxslab.com
  • Introduction:1975,,E-mail:lifeng@qxslab.com
LI Feng1,  
  • role: Corresponding author通信作者
  • Affiliation:

    Qian Xuesen Laboratory of Space Technology, China Academy of Space Technology, Beijing 100094, China

    International Institute for Earth System Science, Nanjing University, Nanjing 210023, China

  • Email:yangxue@qxslab.com
  • Introduction:1985,,E-mail:yangxue@qxslab.com
YANG Xue12*,  
  • Affiliation:

    Qian Xuesen Laboratory of Space Technology, China Academy of Space Technology, Beijing 100094, China

LU Xiaotian1,  
  • Affiliation:

    Qian Xuesen Laboratory of Space Technology, China Academy of Space Technology, Beijing 100094, China

XIN Lei1,  
  • Affiliation:

    Qian Xuesen Laboratory of Space Technology, China Academy of Space Technology, Beijing 100094, China

LU Ming1,  
  • Affiliation:

    Qian Xuesen Laboratory of Space Technology, China Academy of Space Technology, Beijing 100094, China

ZHANG Nan1

resumen

Spaceborne cameras are often called as detector resolution limited system. This is because the detector array generally suffer under sampling. Therefore, high frequency information beyond the detector sampling frequency will leak into the detector array, i.e. every remote sensing image will include some high frequency components. Since the platform keep drifting and vibrating even in the geostationary orbit, every remote sensing image contains unique high frequency information. By collecting those high frequency components from a sequence of images, a high resolution image can be reconstructed. This is the theoretical basis of super resolution technique. Moreover, with the widespread use of spaceborne CMOS array detectors, it is possible to obtain hyper-temporal data, which brings opportunities for spaceborne CMOS Cameras. A new hyper-temporal imaging mode for spaceborne CMOS cameras was proposed in the paper. By using a CMOS camera to continuously and quickly capture sequence of data, many frames of images within the same area can be extracted. By solving an ill-conditioned equation, high resolution images with improved quality can be achieved, that is, digital time delay integration TDI (Time Delay Integration), Modulation Transfer Function (MTF) and Super Resolution can be implemented at the same time. In general, engineers would like to set long expose time for spaceborne cameras to ensure SNR for remote sensing images. However, long expose time inevitable bring blur which severely decrease the quality of remote sensing images. The advantage of this new imaging method is that it can freeze the images to avoid blur as speckle imaging technique widely used in astronomy community. To reconstruct an improved quality and high resolution image, we need a good understanding of the whole process of capturing LR images. Since spaceborne cameras can only capture the reflected light from the surface of the earth and the reflected light suffers from the air turbulence and diffusion from the optical lens system. Therefore, mathematically modeling the image degenerating procedure is very important. As we all know that image restoration is an ill-conditioned problem. In terms of solving the ill-conditioned problem, a mixed sparse representations is used. In general, it is very difficult to find a common sparse representation for remote sensing images because of complicated ground features. In the paper, a remote sensing image is regarded as a combination of sub-image of smooth, edges and point components, respectively. Since each domain transformation method is only capable of representing a particular kind of ground objects or textures, a group of domain transformations are used to sparsely represent each sub-images. By using the generalized sparse representation, image restoration can be solved through the traditional L1 norm based optimal algorithm method the iterative thresholding algorithm. Experimental results based on the low-orbit optical remote sensing satellite OVS-1A, Jilin-1 video 03 satellite and the geostationary optical satellite GF-4 show that both the signal-to-noise ratio, image clarity and spatial resolution have been significantly improved. The proposed method holds promise to bring new remote sensing imagery products with high resolution of improved quality for satellites in orbit. Moreover, the method can also save the cost for future planned satellites by reducing the volume and weight of the optical camera payload.

palabra clave

hyper-temporal data;small satellite;Time Delay Integration(TDI);Modulation Transfer Function(MFT)

References

  1. 1.
    Burns P D and Williams D. 2018. Camera resolution and distortion: advance edge fitting//Proceedings of the IS&T Electronic Imaging Symposium 2018, Image Quality and System Performance XV. 2018(2): 171-1-171-5.
  2. 2.
    Cheng J H and Bo Y C. 2015. A method for measuring signal-to-noise ratio of high spatial resolution remote sensing images. Remote Sensing Technology and Application, 30(3): 469-475
  3. 3.
    Crete F, Dolmiere T, Ladret P and Nicolas M. 2007. The blur effect: perception and estimation with a new no-reference perceptual blur metric//Proceedings Volume 6492, Human Vision and Electronic Imaging XII. San Jose, CA, United States: SPIE
  4. 4.
    Fiete R D. 1999. Image quality and γFN/p for remote sensing systems. Optical Engineering, 38(7): 1229-1240
  5. 5.
    Jiang C. 2015. The Spatial Resolution Improvement of Optical Remote Sensing Image with Regularization Methods. Wuhan: Wuhan University
  6. 6.
    Li F, Xin L, Guo Y, Gao J B and Jia X P. 2017. A framework of mixed sparse representations for remote sensing images. IEEE Transactions on Geoscience and Remote Sensing, 55(2): 1210-1221
  7. 7.
    Liu Y N, Sun D X, Cao K Q, Liu S F, Chai M Y, Liang J and Yuan J. 2020. Evaluation of GF-5 AHSI on-orbit instrument radiometric performance. Journal of Remote Sensing, 24(4): 352-359
  8. 8.
    Meng X C, Sun W W, Ren K, Yang G, Shao F and Fu R D. 2020. Spatial-spectral fusion of GF-5/GF-1 remote sensing images based on multiresolution analysis. Journal of Remote Sensing, 24(4): 379-387
  9. 9.
    Srivastava A K. 2011. A Novel Approach of Land Cover Change Mapping using Hyper Temporal Images. Enschede, Netherlands: University of Twente
  10. 10.
    Yang X, Li F, Xin L, Lu X T, Lu M and Zhang N. 2020. An improved mapping with super-resolved multispectral images for geostationary satellites. Remote Sensing, 12(3): 466
  11. 11.
    Zhan B C, Li F and Lu M. 2020. HDR synthesis technology for spaceborne CMOS cameras based on virtual digital TDI. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 13: 3824-3833
  12. 12.
    Zhu X B, Tian Q J, Xu J K, Lyu C G and Wang L. 2019. Radiation performance simulation and analysis of the signal-to-noise ratio for GF-4 geostationary satellite: in the case of the coastal water in Hong Kong. Journal of Remote Sensing, 23(3): 526-546

Leer el texto completo

The above content is generated by Large Model Translation. The translated content is for reference only. We do not assume any commercial or legal responsibilty for any consequences arising from the use of our website