A　new hyper-temporal imaging mode for spaceborne CMOS cameras

Feng LI; Xue YANG; Xiaotian LU; Lei XIN; Ming LU; Nan ZHANG

doi:10.11834/jrs.20210607

Platforms & Loads | Views : 0 下载量: 2119 CSCD: 3

PDF
Export
Share
Collection
Album

A　new hyper-temporal imaging mode for spaceborne CMOS cameras
Vol. 25, Issue 1, Pages: 514-525(2021)
Received：20 October 2020，

Published：07 January 2021
DOI： 10.11834/jrs.20210607
稿件说明：

移动端阅览

李峰，杨雪，鲁啸天，辛蕾，鹿明，张南.2021.面向星载CMOS相机的超时相工作方式研究.遥感学报，25（1）： 514-525 Li F ，Yang X ，Lu X T，Xin L，Lu M and Zhang N. 2021. A new hyper-temporal imaging mode for spaceborne CMOS cameras. National Remote Sensing Bulletin， 25（1）：495-506［DOI：10.11834/jrs.20210607］ DOI：

Feng LI, Xue YANG, Xiaotian LU, et al. A　new hyper-temporal imaging mode for spaceborne CMOS cameras[J]. National Remote Sensing Bulletin, 2021, 25(1): 514-525. DOI： 10.11834/jrs.20210607.

摘要

随着星载面阵CMOS探测器的广泛使用，使得获取超时相数据成为可能，这为新型对地遥感工作模式带来新的发展机遇。本文不再局限于采用单一技术解决单一技术指标的传统解决问题的方式，系统性地提出一种面向星载面阵CMOS相机的新型成像方式，利用面阵CMOS相机连续快速曝光在极短的时间内获取同一观测区域的超时相序列数据，通过图像重建的方式，实现一揽子的图像质量提升，即同时实现虚拟数字时间延迟积分TDI（Time Delay Integration）、调制传输函数MTF（Modulation Transfer Function）补偿和空间分辨率GSD（Ground Sampling Distance）提升。这种新型成像方式的优点是，可以改善星载光学相机是探测器受限系统的窘境，进而在不改变光学系统的情况下，通过求解一个病态方程，实现对地遥感图像空间分辨率与成像质量的综合提升。基于实验室的靶标仿真实验数据、基于低轨光学遥感卫星OVS-1A、吉林一号视频03卫星和高分四号卫星的真实数据实验结果表明，无论是信噪比，图像清晰度还是空间分辨率都有明显提升。这种新型成像方式已被中国后续某地球同步轨道光学成像卫星所采用，可以预见的是，这种成像方式不仅可以使得在轨卫星发布更高分辨率与更好图像质量的产品，盘活在轨卫星的探测资源；在实现同样空间分辨率与图像质量的前提下，可以有效降低光学相机载荷的体积与重量，进而可以有效降低未来光学卫星的研制成本。

Abstract

Spaceborne cameras are often called as detector resolution limited system. This is because the detector array generally suffer under sampling. Therefore

high frequency information beyond the detector sampling frequency will leak into the detector array

i.e. every remote sensing image will include some high frequency components. Since the platform keep drifting and vibrating even in the geostationary orbit

every remote sensing image contains unique high frequency information. By collecting those high frequency components from a sequence of images

a high resolution image can be reconstructed. This is the theoretical basis of super resolution technique. Moreover

with the widespread use of spaceborne CMOS array detectors

it is possible to obtain hyper-temporal data

which brings opportunities for spaceborne CMOS Cameras. A new hyper-temporal imaging mode for spaceborne CMOS cameras was proposed in the paper. By using a CMOS camera to continuously and quickly capture sequence of data

many frames of images within the same area can be extracted. By solving an ill-conditioned equation

high resolution images with improved quality can be achieved

that is

digital time delay integration TDI (Time Delay Integration)

Modulation Transfer Function (MTF) and Super Resolution can be implemented at the same time. In general

engineers would like to set long expose time for spaceborne cameras to ensure SNR for remote sensing images. However

long expose time inevitable bring blur which severely decrease the quality of remote sensing images. The advantage of this new imaging method is that it can freeze the images to avoid blur as speckle imaging technique widely used in astronomy community. To reconstruct an improved quality and high resolution image

we need a good understanding of the whole process of capturing LR images. Since spaceborne cameras can only capture the reflected light from the surface of the earth and the reflected light suffers from the air turbulence and diffusion from the optical lens system. Therefore

mathematically modeling the image degenerating procedure is very important. As we all know that image restoration is an ill-conditioned problem. In terms of solving the ill-conditioned problem

a mixed sparse representations is used. In general

it is very difficult to find a common sparse representation for remote sensing images because of complicated ground features. In the paper

a remote sensing image is regarded as a combination of sub-image of smooth

edges and point components

respectively. Since each domain transformation method is only capable of representing a particular kind of ground objects or textures

a group of domain transformations are used to sparsely represent each sub-images. By using the generalized sparse representation

image restoration can be solved through the traditional L1 norm based optimal algorithm method the iterative thresholding algorithm. Experimental results based on the low-orbit optical remote sensing satellite OVS-1A

Jilin-1 video 03 satellite and the geostationary optical satellite GF-4 show that both the signal-to-noise ratio

image clarity and spatial resolution have been significantly improved. The proposed method holds promise to bring new remote sensing imagery products with high resolution of improved quality for satellites in orbit. Moreover

the method can also save the cost for future planned satellites by reducing the volume and weight of the optical camera payload.

关键词

Keywords

references

Burns P D and Williams D . 2018 . Camera resolution and distortion: advance edge fitting // Proceedings of the IS&T Electronic Imaging Symposium 2018 , Image Quality and System Performance XV . 2018 ( 2 ): 171-1-171 - 5 .

Cheng J H and Bo Y C . 2015 . A method for measuring signal-to-noise ratio of high spatial resolution remote sensing images . Remote Sensing Technology and Application , 30 ( 3 ): 469 - 475

程结海 , 柏延臣 . 2015 . 一种高空间分辨率遥感影像信噪比测定方法 . 遥感技术与应用 , 30 ( 3 ): 469- 475 [ DOI: 10.11873/j.issn.1004-0323.2015.3.0469 http://dx.doi.org/10.11873/j.issn.1004-0323.2015.3.0469 ]

Crete F , Dolmiere T , Ladret P and Nicolas M . 2007 . The blur effect: perception and estimation with a new no-reference perceptual blur metric // Proceedings Volume 6492 , Human Vision and Electronic Imaging XII. San Jose, CA, United States : SPIE [ DOI: 10.1117/12.702790 http://dx.doi.org/10.1117/12.702790 ]

Fiete R D . 1999 . Image quality and γFN/p for remote sensing systems . Optical Engineering , 38 ( 7 ): 1229 - 1240 [ DOI: 10.1117/1.602169 http://dx.doi.org/10.1117/1.602169 ]

Jiang C . 2015 . The Spatial Resolution Improvement of Optical Remote Sensing Image with Regularization Methods . Wuhan : Wuhan University

江铖 . 2015 . 光学遥感影像空间分辨率提升的正则化方法研究 . 武汉 : 武汉大学

Li F , Xin L , Guo Y , Gao J B and Jia X P . 2017 . A framework of mixed sparse representations for remote sensing images . IEEE Transactions on Geoscience and Remote Sensing , 55 ( 2 ): 1210 - 1221 [ DOI: 10.1109/TGRS.2016.2621123 http://dx.doi.org/10.1109/TGRS.2016.2621123 ]

Liu Y N , Sun D X , Cao K Q , Liu S F , Chai M Y , Liang J and Yuan J . 2020 . Evaluation of GF-5 AHSI on-orbit instrument radiometric performance . Journal of Remote Sensing , 24 ( 4 ): 352 - 359

刘银年 , 孙德新 , 曹开钦 , 刘书锋 , 柴孟阳 , 梁建 , 原娟 . 2020 . 高分五号可见短波红外高光谱相机在轨辐射性能评估 . 遥感学报 , 24 ( 4 ): 352- 359 [ DOI: 10.11834/jrs.20209258 http://dx.doi.org/10.11834/jrs.20209258 ]

Meng X C , Sun W W , Ren K , Yang G , Shao F and Fu R D . 2020 . Spatial-spectral fusion of GF- 5 /GF- 1 remote sensing images based on multiresolution analysis . Journal of Remote Sensing , 24 ( 4 ): 379 - 387

孟祥超 , 孙伟伟 , 任凯 , 杨刚 , 邵枫 , 符冉迪 . 2020 . 基于多分辨率分析的GF-5和GF-1遥感影像空—谱融合 . 遥感学报 , 24 ( 4 ): 379- 387 [ DOI: 10.11834/jrs.20209214 http://dx.doi.org/10.11834/jrs.20209214 ]

Srivastava A K . 2011 . A Novel Approach of Land Cover Change Mapping using Hyper Temporal Images. Enschede, Netherlands: University of Twente

Yang X , Li F , Xin L , Lu X T , Lu M and Zhang N . 2020 . An improved mapping with super-resolved multispectral images for geostationary satellites . Remote Sensing , 12 ( 3 ): 466 [ DOI: 10.3390/rs12030466 http://dx.doi.org/10.3390/rs12030466 ]

Zhan B C , Li F and Lu M . 2020 . HDR synthesis technology for spaceborne CMOS cameras based on virtual digital TDI . IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing , 13 : 3824 - 3833 [ DOI: 10.1109/JSTARS.2020.3005667 http://dx.doi.org/10.1109/JSTARS.2020.3005667 ]

Zhu X B , Tian Q J , Xu J K , Lyu C G and Wang L . 2019 . Radiation performance simulation and analysis of the signal-to-noise ratio for GF-4 geostationary satellite: in the case of the coastal water in Hong Kong . Journal of Remote Sensing , 23 ( 3 ): 526 - 546

朱小波 , 田庆久 , 徐凯健 , 吕春光 , 王玲 . 2019 . 高分四号静止卫星辐射性能模拟与信噪比分析——以香港近海岸水体为例 . 遥感学报 , 23 ( 3 ): 526- 546 [ DOI: 10.11834/jrs.20197128 http://dx.doi.org/10.11834/jrs.20197128 ]

Alert me when the article has been cited

提交

Super-resolution reconstruction of hypertemporal remote sensing images based on self-attention