Multi-scale feature extraction of hyperspectral image with guided filtering

  • role: First author第一作者
  • Affiliation:

    Faculty of Forestry, Southwest Forestry University, Kunming 650224, China

  • Email:wlgbain@126.com
  • Introduction:王雷光(1982— ),男,副教授,研究方向为高分辨率/高光谱影像分析及林业应用。E-mail:wlgbain@126.com
Leiguang WANG1,  
  • Affiliation:

    Faculty of Forestry, Southwest Forestry University, Kunming 650224, China

Xiaowang CAO1,  
  • Affiliation:

    Faculty of Forestry, Southwest Forestry University, Kunming 650224, China

Yalan ZHENG1,  
  • role: Corresponding author通信作者
  • Affiliation:

    Department of Printing and Packaging, Wuhan University, Wuhan 430079, China

    School of Design, Southwest Forestry University, Kunming 650224, China

  • Email:daiqinling@126.com
  • Introduction:代沁伶(1982— ),女,博士研究生,研究方向为图像数字滤波处理及应用研究。E-mail:daiqinling@126.com
Qinling DAI23*

résumé

Features extracted from a single scale cannot effectively express differences among land objects and recognize object boundaries.Thus, hyperspectral image classification suffers from low classification accuracy and the “pepper-and-salt” phenomenon. In this context, we propose a set of multi-scale spatial features that is based on guided filtering to improve the performance of image classification in quantitative accuracy and visual interpretation. The structure-transferring property of the guided filtering is investigated to appropriately represent land objects with different sizes. The proposed feature extraction and classification algorithm consists of three steps. First, Principal Component Analysis (PCA) is used to reduce the dimensionality of hyperspectral images and remove noise. Second, the first several principal components that have the most amount of information are guided by the first principal component to obtain filtered features. Multi-scale features are extracted by guided filtering with increasing radii, which can represent structures of different land cover types. Finally, the feature set is fed into classifiers for image classification. We operated experiments on one synthetic and three hyperspectral datasets, namely, Pavia University, Pavia Center, and Salinas. Multiple multi-scale features, including multi-scale features based on guided filtering, multi-scale morphological, and multi-scale texture features, were extracted. Three advanced classifiers, namely, Support Vector Machine(SVM), Random Forest(RF), and K-Nearest Neighbor(KNN), were considered for comparison. The results of the experiments conducted on the synthetic data set showed that the proposed feature extraction method could better smooth the inner pixels of land objects while preserving object boundaries compared with multi-scale morphological features. Compared with the combination of multi-scale morphological features and SVM, the combination of multi-scale guided filtering features and SVM achieved a 6.5% increment in overall accuracy on the Pavia University dataset. The highest classification accuracies for the Pavia Centre and Salinas images were 98.51% and 98.39%, respectively.These resultswere achieved by the proposed multi-scale guided filtering method. A single scale cannot effectively represent the spatial information of land objects. Thus, multi-scale features are extracted using guided filtering. These features can preserve the spatial structures transferred from the guidance image and smooth the details of the input image due to the structure-transferring property of guided filtering. Land objects with various scales can also be effectively described by these multi-scale filtering features by setting different filtering window sizes. The quantitative results and visual inspection showthat multi-scale filtering features can effectively describe the structures of land objects in comparison with morphological and texture features and thus result in high classification accuracy and better visual quality. The proposed feature is suitable for analyzing land scenes with complicated structures, such as urban areas.

mots-clés

hyperspectral image;guided filter;multi-scale feature;classification;spatial information

References

  1. 1.
    Altman N S. 1992. An introduction to kernel and nearest-neighbor nonparametric regression. The American Statistician, 46(3): 175–185
  2. 2.
    Baraldi A and Parmiggiani F. 1995. An investigation of the textural characteristics associated with gray level cooccurrence matrix statistical parameters. IEEE Transactions on Geoscience and Remote Sensing, 33(2): 293–304
  3. 3.
    Benediktsson J A, Palmason J A and Sveinsson J R. 2005. Classification of hyperspectral data from urban areas based on extended morphological profiles. IEEE Transactions on Geoscience and Remote Sensing, 43(3): 480–491
  4. 4.
    Benediktsson J A, Pesaresi M and Amason K. 2003. Classification and feature extraction for remote sensing images from urban areas based on morphological transformations. IEEE Transactions on Geoscience and Remote Sensing, 41(9): 1940–1949
  5. 5.
    Cao X W, Zhao W F and Wang L G. 2015. Evaluation of multiple and multiscale morphological profiles on the classification of hyperspectral image//Proceedings of the SPIE Volume 9811, MIPPR 2015: Multispectral Image Acquisition, Processing, and Analysis. Enshi, China: SPIE: 981112 [DOI: 10.1117/12.2205487]
  6. 6.
    Chang C C, Chien L J and Lee Y J. 2011. A novel framework for multi-class classification via ternary smooth support vector machine. Pattern Recognition, 44(6): 1235–1244
  7. 7.
    Fang K N, Wu J B, Zhu J P and Xie B C. 2011. A review of technologies on random forests. Statistics and Information Forum, 26(3): 32–38 (
  8. 8.
    Gamba P, Dell’Acqua F and Landgrebe D. 2016. Hyperspectral Remote Sensing Scenes. [2016-09-20]
  9. 9.
    Hastie T, Tibshirani R T and Friedman J. 2009. The Elements of Statistical Learning: Data Mining, Inference, and Prediction. 2nd ed.New York: Springer-Verlag: 61–69
  10. 10.
    He K M, Sun J and Tang X O. 2013. Guided image filtering. IEEE Transactions on Pattern Analysis And Machine Intelligence, 35(6): 1397–1409
  11. 11.
    Ho T K. 1998. The random subspace method for constructing decision forests. IEEE Transactions on Pattern Analysis and Machine Intelligence, 20(8): 832–844
  12. 12.
    Huang X, Zhang L P and Li P X. 2007. An adaptive multiscale information fusion approach for feature extraction and classification of IKONOS multispectral imagery over urban areas. IEEE Geoscience and Remote Sensing Letters, 4(4): 654–658
  13. 13.
    Huang X, Zhang L P and Li P X. 2007. Classification of high spatial resolution remotely sensed imagery based on the fusion of spectral and shape features. Journal of Remote Sensing, 11(2): 193–200 (
  14. 14.
    Ji J, Gao P F, Jia N N, Yang R, Guo H M, Hu Q and Zhuang S L. 2015. Spectral smoothing with adaptive multiscale window average. Spectroscopy and Spectral Analysis, 35(5): 1445–1449 (
  15. 15.
    Ji R R, Gao Y, Hong R C, Liu Q, Tao D C and Li X L. 2014. Spectral-spatial constraint hyperspectral image classification. IEEE Transactions on Geoscience and Remote Sensing, 52(3): 1811–1824
  16. 16.
    Li S T, Kang XD and Hu J W. 2013. Image fusion with guided filtering. IEEE Transactions on Image Processing, 22(7): 2864–2875
  17. 17.
    Licciardi G, Marpu P R, Chanussot J and Benediktsson J A. 2012. Linear versus nonlinear PCA for the classification of hyperspectral data based on the extended morphological profiles. IEEE Geoscience and Remote Sensing Letters, 9(3): 447–451
  18. 18.
    Liu C, Hong L, Chen J, Chu S S and Deng M. 2015. Fusion of pixel-based and multi-scale region-based features for the classification of high-resolution remote sensing image. Journal of Remote Sensing, 19(2): 228–239 (
  19. 19.
    Liu M M, Liu Y L, Sun G Q and Peng L. 2014. SVM L and cover classification based on spectral and textural features using stratified samples. Remote Sensing Technology and Application, 29(2): 315–323 (
  20. 20.
    Mura M D, Villa A, Benediktsson J A, Chanussot J and Bruzzone L. 2011. Classification of hyperspectral images by using extended morphological attribute profiles and independent component analysis. IEEE Geoscience and Remote Sensing Letters, 8(3): 542–546
  21. 21.
    Quesada-Barriuso P, Arguello F and Heras D B. 2014. Spectral–spatial classification of hyperspectral images using wavelets and extended morphological profiles. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 7(4): 1177–1185
  22. 22.
    Shen L L and Jia S. 2011. Three-dimensional Gabor wavelets for pixel-based hyperspectral imagery classification. IEEE Transactions on Geoscience and Remote Sensing, 49(12): 5039–5046
  23. 23.
    Wang LG, Dai QL, Xu Q Z and Zhang Y. 2015. Constructing hierarchical segmentation tree for feature extraction and land cover classification of high resolution MS imagery. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 8(5): 1946–1961
  24. 24.
    Yi M, Tan X, Zhang P Q and Xu W X. 2015. A classification method of informative vector machine for hyperspectral imagery based ontexture and spectral features. Journal of Geomatics Science and Technology, 32(4): 368–372, 378 (
  25. 25.
    Yu X C, Tan X, Fu Q Y and Wang W T. 2014. Combined texture-spectral feature for multiple kernel classification of hyperspectral images. Bulletin of Surveying and Mapping(9): 38–42 (
  26. 26.
    Zhang C S, Zheng Y W, Huang X B and Cui W H. 2015. Hyperspectral image classification based on the weighted probabilistic fusion of multiple spectral-spatial features. Acta Geodaetica et CartographicaSinica, 44(8): 909–918 (
  27. 27.
    Zhang G and Ma Z M. 2010. An approach of using gabor wavelets for texture feature extraction. Journal of Image and Graphics, 15(2): 247–254 (
  28. 28.
    Zhang X G. 2010. Pattern Recognition.3rd ed. Beijing: Tsinghua University Press
  29. 29.
    Zhao W F, Dai QL and Wang L G. 2015. Remote sensing fusion based on guided image filtering//Proceedings of SPIE Volume 9815, MIPPR 2015: Remote Sensing Image Processing, Geographic Information Systems, and Other Applications. Enshi, China: 98150H [DOI: 10.1117/12.2205139]
  30. 30.
    Zheng C, Sun D Q and Chen X H. 2013. Remote sensing image segmentation based on a multiresolution region granularity analysis method. Spectroscopy and Spectral Analysis, 33(7): 1912–1916 (

Lire l'article complet

The above content is generated by Large Model Translation. The translated content is for reference only. We do not assume any commercial or legal responsibilty for any consequences arising from the use of our website