Anterior|Siguiente

New super-resolution reconstruction method based on Mixed Sparse Representations

  • role： First author第一作者
  • Affiliation：

    Qian Xuesen Laboratory of Space Technology, China Academy of Space Technology, Beijing 100094, China

  • Email：yangxue @qxslab.cn
  • Introduction：杨雪，研究方向为图像超分辨率重建算法研究及应用。E-mail： yangxue @qxslab.cn
YANG Xue,  
  • role： Corresponding author通信作者
  • Affiliation：

    Qian Xuesen Laboratory of Space Technology, China Academy of Space Technology, Beijing 100094, China

  • Email：lifeng @qxslab.cn
  • Introduction：李峰，研究方向为图像重建、压缩感知等。E-mail： lifeng @qxslab.cn
LI Feng*,  
  • Affiliation：

    Qian Xuesen Laboratory of Space Technology, China Academy of Space Technology, Beijing 100094, China

LU Ming,  
  • Affiliation：

    Qian Xuesen Laboratory of Space Technology, China Academy of Space Technology, Beijing 100094, China

XIN Lei,  
  • Affiliation：

    Qian Xuesen Laboratory of Space Technology, China Academy of Space Technology, Beijing 100094, China

LU Xiaotian,  
  • Affiliation：

    Qian Xuesen Laboratory of Space Technology, China Academy of Space Technology, Beijing 100094, China

ZHANG Nan

resumen

When processing remote sensing images with complex features, the conventional Super-Resolution Reconstruction (SRR) methods are often not ideal, especially for remote sensing images containing various non-uniform object information. A universal method to solve this problem is difficult to construct at present. A new SR reconstruction method of mixed sparse representation model (MSR-SRR) combined with the sparse representation and non-convex high-order total variational regularizer has been proposed to solve this problem. In this method, the sparse representation of remote sensing images in multiple transform domains is regarded as a prior probability model, and the SR reconstruction is completed by regularization. The obtained image not only retains the edge information of the image result by SR reconstruction, but also smoothens the “ladder effect” of the image. The efficiency of operation and the quality of SR reconstruction results are improved by an effective re-weighted l1 alternating direction method. Results show that the sharpness of the image increases by 31.74% on the average, the half-peak width of PSFs is the largest, and the Gaussian variance value reaches 1.8415. The GF-4 satellite images have been selected to carry out validation experiment to verify the feasibility and validity of MSR-SRR. The reconstruction results show that the images using the MSR-SRR method have better definition, richer details, and higher quality than those with non-uniform interpolation, the POCS method, and IBP method. The support vector machine method is used to classify and evaluate the accuracy of the images before and after SR reconstruction. The results show that the overall accuracy and Kappa coefficient of the reconstructed super-resolution image are improved more significantly than the original image classification results. The OA value increases by 5.96%, and the Kappa coefficient increases by 9.7%. The findings confirmed that the MSR-SRR method is effective and feasible and has extensive practical value.

palabra clave

remote sensing;GF-4;Super-resolution reconstruction (SRR);Mixed sparse representation (MSR);Total variation (TV);Non-convex

References

  1. 1.
    Adam T and Paramesran R. 2019. Image denoising using combined higher order non-convex total variation with overlapping group sparsity. Multidimensional Systems and Signal Processing, 30: 503-527
  2. 2.
    Babacan S D, Molina R and Katsaggelos A K. 2011. Variational Bayesian super resolution. IEEE Transactions on Image Processing, 20(4): 984-999
  3. 3.
    Bai M R, Zhang X J and Shao Q Q. 2016. Adaptive correction procedure for TVL1 image deblurring under impulse noise. Inverse Problems, 32(8): 085004
  4. 4.
    Bao H, Li Z L, Chai F M and Yang H S. 2015. Filter wheel mechanism for optical remote sensor in geostationary orbit. Optics and Precision Engineering, 23(12): 3357-3363
  5. 5.
    Beck A and Teboulle M. 2009. A fast iterative shrinkage-thresholding algorithm for linear inverse problems. SIAM Journal on Imaging Sciences, 2(1): 183-202
  6. 6.
    Chang H B, Lou Y F, Duan Y P and Marchesini S. 2018. Total variation--based phase retrieval for Poisson noise removal. SIAM Journal on Imaging Sciences, 11(1): 24-55
  7. 7.
    Cheng W. 2018. Detection of Sea Motion Targets in Multi-spectral Imagery of Static Orbiting Staring Satellites. Wuhan: Huazhong University of Science and Technology (程伟. 2018. 静轨凝视多光谱影像海面运动目标检测. 武汉: 华中科技大学)
  8. 8.
    Condat L. 2014. A generic proximal algorithm for convex optimization-application to total variation minimization. IEEE Signal Processing Letters, 21(8): 985-989
  9. 9.
    Crete F, Dolmiere T, Ladret P and Nicolas M. 2007. The blur effect: perception and estimation with a new no-reference perceptual blur metric//Proceedings of SPIE 6492, Human Vision and Electronic Imaging XII. San Jose: SPIE
  10. 10.
    He C, Hu C H, Li X L, Yang X G and Zhang W. 2016. A parallel alternating direction method with application to compound l1-regularized imaging inverse problems. Information Sciences, 348: 179-197
  11. 11.
    Irani M and Peleg S. 1991. Improving resolution by image registration. CVGIP: Graphical Models and Image Processing, 53(3): 231-239
  12. 12.
    Jiang C, He H Y and Ma Z Q. 2019. Instrument simulation of multispectral remote sensing images in the frame of GF-4 satellite system//Proceedings of SPIE 11156, Earth Resources and Environmental Remote Sensing/GIS Applications X. Strasbourg: SPIE
  13. 13.
    Lei J F, Zhang S Y, Luo L, Xiao J S and Wang H. 2018. Super-resolution enhancement of UAV images based on fractional calculus and POCS. Geo-spatial Information Science, 21(1) 56-66
  14. 14.
    Li F, Li C R, Tang L L and Guo Y. 2014. Elastic registration for airborne multispectral line scanners. Journal of Applied Remote Sensing, 8(1): 083614
  15. 15.
    Li F, Xin L, Guo Y, Gao D S, Kong X H and Jia X P. 2018a. Super-resolution for GaoFen-4 remote sensing images. IEEE Geoscience and Remote Sensing Letters, 15(1): 28-32
  16. 16.
    Li F, Xin L, Guo Y, Gao J B and Jia X P. 2017. A framework of mixed sparse representations for remote sensing images. IEEE Transactions on Geoscience and Remote Sensing, 55(2): 1210-1221
  17. 17.
    Li F, Xin L, Guo Y and Jia X P. 2018b. Multitemporal mid-infrared imagery based calibration and super resolution for gaofen-4//IGARSS 2018-2018 IEEE International Geoscience and Remote Sensing Symposium. Valencia: IEEE: 7038-7041
  18. 18.
    Liu J, Huang T Z, Selesnick I W, Lv X G and Chen P Y. 2015. Image restoration using total variation with overlapping group sparsity. Information Sciences, 295: 232-246
  19. 19.
    Liu Y, Yao L B, Xiong W and Zhou Z M. 2019. GF-4 satellite and automatic identification system data fusion for ship tracking. IEEE Geoscience and Remote Sensing Letters, 16(2): 281-285
  20. 20.
    Nie J, Deng L, Hao X L, Liu M and He Y. 2018. Application of GF-4 satellite in drought remote sensing monitoring: a case study of Southeastern Inner Mongolia. Journal of Remote Sensing, 22(3): 400-407
  21. 21.
    Nitta K, Shogenji R, Miyatake S and Tanida J. 2006. Image reconstruction for thin observation module by bound optics by using the iterative backprojection method. Applied Optics, 45(13): 2893-2900
  22. 22.
    Ramana M V, Reddy E S and Satayanarayana C H. 2018. Curvelet Transform for efficient static texture classification and image fusion. International Journal of Image, Graphics and Signal Processing, 10(5): 64-71
  23. 23.
    Sha F, Zandavi S M and Chung Y Y. 2019. Fast deep parallel residual network for accurate super resolution image processing. Expert Systems with Applications, 128: 157-168
  24. 24.
    Shi M Z, Han T T and Liu S Q. 2016. Total variation image restoration using hyper-Laplacian prior with overlapping group sparsity. Signal Processing, 126: 65-76
  25. 25.
    Sun Y, Babu P and Palomar D P. 2017. Majorization-minimization algorithms in signal processing, communications, and machine learning. IEEE Transactions on Signal Processing, 65(3): 794-816
  26. 26.
    Sun Y J, Wang Z H, Qin Q M, Han G H, Ren H Z and Huang J F. 2018. Retrieval of surface albedo based on GF-4 geostationary satellite image data. Journal of Remote Sensing, 22(2): 220-233
  27. 27.
    Tsai R Y and Huang T S. 1984. Multiframe image restoration and registration. Advances in Computer Vision and Image Processing, 1(2) 317-339
  28. 28.
    Wang Y L, Bi S S, Sun M L and Cai M Y. 2014. Image retrieval algorithm based on SIFT, K-means and LDA. Journal of Beijing University of Aeronautics and Astronautics, 40(9) 1317-1322
  29. 29.
    Woods M and Katsaggelos A. 2017. A Bayesian multi-frame image super-resolution algorithm using the Gaussian information filter//Proceedings of 2017 IEEE International Conference on Acoustics, Speech and Signal Processing. New Orleans: IEEE
  30. 30.
    Wu C L and Tai X C. 2010. Augmented Lagrangian method, dual methods, and split Bregman iteration for ROF, vectorial TV, and high order models. SIAM Journal on Imaging Sciences, 3(3): 300-339
  31. 31.
    Xu L N and He L X. 2017. GF-4 images super resolution reconstruction based on POCS. Acta Geodaetica et Cartographica Sinica, 46(8): 1026-1033
  32. 32.
    Yang J M, Wu Y, Wei Y X, Wang B, Ru C, Ma Y Y and Zhang Y. 2019. A model for the fusion of multi-source data to generate high temporal and spatial resolution VI data. Journal of Remote Sensing, 23(5): 935-943
  33. 33.
    Yang X, Li F, Xin L, Wang C, Wang X Y and Chang X. 2018. Destriping methods for high resolution satellite multispectral remote sensing image based on GPU adaptive partitioning technology. International Society for Optics and Photonics//Proceedings of SPIE 10783, Remote Sensing for Agriculture, Ecosystems, and Hydrology XX. Berlin: SPIE
  34. 34.
    Yang X, Li F, Xin L, Zhang N, Lu X T and Xiao H C. 2019. Finer scale mapping with super resolved GF-4 satellite images. International Society for Optics and Photonics//Proceedings of SPIE 11155, Image and Signal Processing for Remote Sensing XXV. Strasbourg: SPIE
  35. 35.
    Yang R, Liu Z H and She W J. 2019. Simultaneous super-resolution reconstruction based on plane array staring remote sensing images. Infrared and Laser Engineering, 48(1): 0126002
  36. 36.
    Zhang D S. 2019. Wavelet transform//Zhang D S, ed. Fundamentals of Image Data Mining. Cham: Springer: 35-44
  37. 37.
    Zhao W, Bian X F, Huang F, Wang J and Abidi M A. 2018. Fast image super-resolution algorithm based on multi-resolution dictionary learning and sparse representation. Journal of Systems Engineering and Electronics, 29(3): 471-482
  38. 38.
    Zhou F, Jin W, Gong F and Fu R D. 2017. Super resolution reconstruction of MODIS image based on topic learning and sparse representation. Journal of Remote Sensing, 21(2): 253-262
  39. 39.
    Zhou X M, Wang K Y and Fu J. 2017. A method of SIFT simplifying and matching algorithm improvement//Proceedings of 2016 International Conference on Industrial Informatics-Computing Technology, Intelligent Technology, Industrial Information Integration (ICIICII). Wuhan: IEEE
  40. 40.
    Zhu X B, Tian Q J, Xu K J, Lv C G and Wang L. 2019. Radiation performance simulation and analysis of the signal-to-noise ratio for GF-4 geostationary satellite: in the case of the coastal water in Hong Kong. Journal of Remote Sensing, 23(3): 526-546

Leer el texto completo

The above content is generated by Large Model Translation. The translated content is for reference only. We do not assume any commercial or legal responsibilty for any consequences arising from the use of our website