Précédent|Prochain

Spectral super-resolution using optimized dictionary learning via spectral library and its effects on classification

  • role： First author第一作者
  • Affiliation：

    Department of Electronic Engineering, Tsinghua University, Beijing 100084, China

  • Email：hxl15@tsinghua.org.cn
  • Introduction：韩晓琳，研究方向为图像处理、模式识别、字典学习与深度学习。E-mail： hxl15@tsinghua.org.cn
HAN Xiaolin,  
  • Affiliation：

    Department of Electronic Engineering, Tsinghua University, Beijing 100084, China

ZHANG Huan,  
  • role： Corresponding author通信作者
  • Affiliation：

    Department of Electronic Engineering, Tsinghua University, Beijing 100084, China

  • Email：wdsun@tsinghua.edu.cn
  • Introduction：孙卫东，研究方向为空间信息处理与应用、图像处理、模式识别。E-mail： wdsun@tsinghua.edu.cn
SUN Weidong*

résumé

The spectral library can contain the spectral information on the whole types of ground surface objects in the observation area of hyperspectral images. Thus, the optimized dictionary learning via spectral library refers to the process of constructing optimized spectral dictionary under strict theoretical derivation, in which the spectra in the spectral library are used as training samples. The abovementioned process enables the spectra in the hyperspectral image to be sparsely represented under the learned spectral dictionary. To this end, a new spectral super-resolution method using optimized dictionary learning via spectral library is proposed in this study. This method uses only one high spatial multispectral image to reconstruct high spatial hyperspectral image. The aforementioned problem is formulated in the framework of sparse representation, as an estimation of the band matching matrix, the optimized spectral dictionary, and the corresponding sparse coefficients. Specifically, a band matching method is proposed to map the common spectral library to a specific spectral library corresponding to the reconstructed high spatial hyperspectral image. Then, an optimization of spectral dictionary and its corresponding sparse coefficients is derived theoretically using the alternating direction method of multipliers (ADMM) algorithm and by utilizing the abovementioned specific spectral library and the high spatial multispectral image. Comparison results with the relative methods demonstrate that our method not only can achieve a high-quality reconstruction of the high spatial hyperspectral image but also can significantly improve the classification accuracy of multispectral images by even only using one high spatial multispectral image.We aim to reconstruct high spatial hyperspectral image only from one high spatial multispectral image with high quality.Three steps of our proposed method are discussed in detail. First, the band matching matrix is estimated using the band wavelength information. Second, the matched spectral dictionary is optimized using the matched spectral library and the high spatial multispectral image. Third, the equivalent sparse coefficient matrix with respect to the matched spectral dictionary is derived theoretically and estimated iteratively.Extensive experiments and comparative analyses of the proposed method are conducted on various datasets to demonstrate the performance and practical application value of our proposed method. The improvement in classification accuracy on the reconstructed high spatial hyperspectral images is also evaluated using some typical classification methods.A spectral super-resolution method is proposed, and it uses only one high spatial multispectral image to reconstruct high spatial hyperspectral image. A band matching matrix, which is used to map the common spectral library to a specific spectral library, is obtained by solving the minimum distance problem. A spectral dictionary and its corresponding sparse coefficient matrix are optimized from the matched spectral library and the high spatial hyperspectral image by minimizing augmented Lagrangian function using ADMM iteratively. Experiments on simulated and real datasets demonstrate that our proposed method can produce comparable results for the spectral super-resolution to the other relative state-of-the-art reconstruction or fusion-based methods using additional low spatial hyperspectral image. It can also provide higher reconstruction quality than the HIRSL method without optimization. Our proposed SODL method that uses only one multispectral image may help develop new light and small high spatial hyperspectral imaging equipment.

mots-clés

spectral super-resolution;spectral library;sparse representation;optimized dictionary learning;landcover classification

References

  1. 1.
    Aiazzi B, Baronti S and Selva M. 2007. Improving component substitution pansharpening through multivariate regression of MS + Pan data. IEEE Transactions on Geoscience and Remote Sensing, 45(10): 3230-3239
  2. 2.
    Akhtar N, Shafait F and Mian A. 2014. Sparse spatio-spectral representation for hyperspectral image super-resolution\\13th European Conference on Computer Vision. Cham: Springer: 63-78
  3. 3.
    Boyd S, Parikh N, Chu E, Peleato B and Eckstein J. 2011. Distributed optimization and statistical learning via the alternating direction method of multipliers. Foundations and Trends® in Machine Learning, 3(1): 1-122
  4. 4.
    Carper W J, Lillesand T M and Kiefer P W. 1990. The use of intensity-hue-saturation transformations for merging SPOT panchromatic and multispectral image data. Photogrammetric Engineering and Remote Sensing, 56(4): 457-467.
  5. 5.
    Dong C, Loy C C, He K M and Tang X O. 2014. Learning a deep convolutional network for image super-resolution//13th European Conference on Computer Vision. Zurich: Springer: 184-199
  6. 6.
    Dong W S, Fu F Z, Shi G M, Cao X, Wu J J, Li G Y and Li X. 2016. Hyperspectral image super-resolution via non-negative structured sparse representation. IEEE Transactions on Image Processing, 25(5): 2337-2352
  7. 7.
    Ertürk A, Güllü M K, Çeşmeci D, Gerçek D and Ertürk S. 2014. Spatial resolution enhancement of hyperspectral images using unmixing and binary particle swarm optimization. IEEE Geoscience and Remote Sensing Letters, 11(12): 2100-2104
  8. 8.
    Ertürk A, Iordache M D and Plaza A. 2016. Sparse unmixing-based change detection for multitemporal hyperspectral images. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 9(2): 708-719
  9. 9.
    Ghasrodashti E K, Karami A, Heylen R and Scheunders P. 2017. Spatial resolution enhancement of hyperspectral images using spectral unmixing and bayesian sparse representation. Remote Sensing, 9(6): 541
  10. 10.
    Grohnfeldt C, Zhu X X and Bamler R. 2013. Jointly sparse fusion of hyperspectral and multispectral imagery//2013 IEEE International Geoscience and Remote Sensing Symposium. Melbourne: IEEE: 4090-4093
  11. 11.
    Han X L, Yu J, Luo J Q and Sun W D. 2019. Reconstruction from multispectral to hyperspectral image using spectral library-based dictionary learning. IEEE Transactions on Geoscience and Remote Sensing, 57(3): 1325-1335
  12. 12.
    Hu J, Li Y S and Xie W Y. 2017. Hyperspectral image super-resolution by spectral difference learning and spatial error correction. IEEE Geoscience and Remote Sensing Letters, 14(10): 1825-1829
  13. 13.
    Huang B, Song H H, Cui H B, Peng J G and Xu Z B. 2014. Spatial and spectral image fusion using sparse matrix factorization. IEEE Transactions on Geoscience and Remote Sensing, 52(3): 1693-1704
  14. 14.
    Iordache M D, Bioucas-Dias J M and Plaza A. 2014. Collaborative sparse regression for hyperspectral unmixing. IEEE Transactions on Geoscience and Remote Sensing, 52(1): 341-354
  15. 15.
    Kawakami R, Matsushita Y, Wright J, Ben-Ezra M, Tai Y W and Ikeuchi K. 2011. High-resolution hyperspectral imaging via matrix factorization//CVPR 2011. Colorado Springs: IEEE: 2329-2336
  16. 16.
    Keshava N and Mustard J F. 2002. Spectral unmixing. IEEE Signal Processing Magazine, 19(1): 44-57
  17. 17.
    Lan J H, Zou J L, Hao Y S, Zeng Y L, Zhang Y Z and Dong M W. 2018. Research progress on unmixing of hyperspectral remote sensing imagery. Journal of Remote Sensing, 22(1): 13-27
  18. 18.
    Li S T, Li C Y and Kang X D. 2021. Development status and future prospects of multi-source remote sensing image fusion. National Remote Sensing Bulletin, 25(1): 148-166
  19. 19.
    Loncan L, De Almeida L B, Bioucas-Dias J M, Briottet X, Chanussot J, Dobigeon N, Fabre S, Liao W Z, Licciardi G A, Simoes M, Tourneret J Y, Veganzones M A, Vivone G, Wei Q and Yokoya N. 2015. Hyperspectral pansharpening: a review. IEEE Geoscience and Remote Sensing Magazine, 3(3): 27-46
  20. 20.
    Lu X Q, Yuan Y and Yan P K. 2014. Alternatively constrained dictionary learning for image superresolution. IEEE Transactions on Cybernetics, 44(3): 366-377
  21. 21.
    Mei S H, Yuan X, Ji J Y, Wan S, Hou J H and Du Q. 2017. Hyperspectral image super-resolution via convolutional neural network//2017 IEEE International Conference on Image Processing (ICIP). Beijing: IEEE: 4297-4301
  22. 22.
    Nezhad Z H, Karami A, Heylen R and Scheunders P. 2016. Fusion of hyperspectral and multispectral images using spectral unmixing and sparse coding. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 9(6): 2377-2389
  23. 23.
    Ni D and Ma H B. 2015. Spectral-spatial classification of hyperspectral images based on neighborhood collaboration. Acta Automatica Sinica, 41(2): 273-284
  24. 24.
    Pan Z X, Yu J, Xiao C B and Sun W D. 2014. Spectral similarity-based super resolution for hyperspectral images. Acta Automatica Sinica, 40(12): 2797-2807
  25. 25.
    Simões M, Bioucas-Dias J, Almeida L B and Chanussot J. 2015. A convex formulation for hyperspectral image superresolution via subspace-based regularization. IEEE Transactions on Geoscience and Remote Sensing, 53(6): 3373-3388
  26. 26.
    Veganzones M A, Simoes M, Licciardi G, Yokoya N, Bioucas-Dias J M and Chanussot J. 2016. Hyperspectral super-resolution of locally low rank images from complementary multisource data. IEEE Transactions on Image Processing, 25(1): 274-288
  27. 27.
    Villa A, Chanussot J, Benediktsson J A, Ulfarsson M and Jutten C. 2010. Super-resolution: an efficient method to improve spatial resolution of hyperspectral images//2010 IEEE International Geoscience and Remote Sensing Symposium. Honolulu: IEEE, 2003-2006
  28. 28.
    Wang J, Peng J Y, Jiang X Y, Feng X and Zhou J H. 2017. Remote-sensing image fusion using sparse representation with sub-dictionaries. International Journal of Remote Sensing, 38(12): 3564-3585
  29. 29.
    Wang Z, Bovik A C, Sheikh H R and Simoncelli E P. 2004. Image quality assessment: from error visibility to structural similarity. IEEE Transactions on Image Processing, 13(4): 600-612
  30. 30.
    Wei Q, Bioucas-Dias J, Dobigeon N and Tourneret J Y. 2015. Hyperspectral and multispectral image fusion based on a sparse representation. IEEE Transactions on Geoscience and Remote Sensing, 53(7): 3658-3668
  31. 31.
    Xu N, Xiao X Y, Geng X R, You H J and Cao Y G. 2016. Spectral-spatial constrained sparse unmixing of hyperspectral imagery using a hybrid spectral library. Remote Sensing Letters, 7(7): 641-650
  32. 32.
    Xu Y H, Du B, Zhang F and Zhang L P. 2018. Hyperspectral image classification via a random patches network. ISPRS Journal of Photogrammetry and Remote Sensing, 142: 344-357
  33. 33.
    Yokoya N, Grohnfeldt C and Chanussot J. 2017. Hyperspectral and multispectral data fusion: a comparative review of the recent literature. IEEE Geoscience and Remote Sensing Magazine, 5(2): 29-56
  34. 34.
    Yokoya N, Yairi T and Iwasaki A. 2012. Coupled nonnegative matrix factorization unmixing for hyperspectral and multispectral data fusion. IEEE Transactions on Geoscience and Remote Sensing, 50(2): 528-537
  35. 35.
    Yuan Y, Zheng X T and Lu X Q. 2017. Hyperspectral image superresolution by transfer learning. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 10(5): 1963-1974
  36. 36.
    Zhang K, Wang M, Yang S Y, Xing Y H and Qu R. 2016. Fusion of panchromatic and multispectral images via coupled sparse non-negative matrix factorization. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 9(12): 5740-5747
  37. 37.
    Zhao T, Zhang Y F, Xue X Q and He M Y. 2016. Hyperspectral and multispectral image fusion using collaborative representation with local adaptive dictionary pair//2016 IEEE International Geoscience and Remote Sensing Symposium. Beijing: IEEE: 7212-7215
  38. 38.
    Zhu J, Zhou L F and Zhang D R. 2011. Identification for building surface material based on hyperspectral remote sensing//2011 19th International Conference on Geoinformatics. Shanghai: IEEE: 1-5
  39. 39.
    Zhu X X, Spiridonova S and Bamler R. 2012. A pan-sharpening algorithm based on joint sparsity//2012 Tyrrhenian Workshop on Advances in Radar and Remote Sensing (TyWRRS). Naples: IEEE: 177-184

Lire l'article complet

The above content is generated by Large Model Translation. The translated content is for reference only. We do not assume any commercial or legal responsibilty for any consequences arising from the use of our website