Hyperspectral remote sensing image classification based on semi-supervised conditional random field

  • role: First author第一作者
  • Affiliation:

    School of Astronautics, Beihang University, Beijing 100191, China

    Beijing Key laboratory of Digital Media, Beijing 100191, China

  • Email:patrickwu0609@ hotmail.com
  • Introduction:吴俊峰(1986— ),男,博士研究生,研究方向为高光谱遥感图像的分类、目标检测的理论和应用。E-mail:patrickwu0609@ hotmail.com
WU Junfeng12,  
  • Affiliation:

    School of Astronautics, Beihang University, Beijing 100191, China

    Beijing Key laboratory of Digital Media, Beijing 100191, China

JIANG Zhiguo12,  
  • role: Corresponding author通信作者
  • Affiliation:

    School of Astronautics, Beihang University, Beijing 100191, China

    Beijing Key laboratory of Digital Media, Beijing 100191, China

  • Email:hangpengzhang@buaa.edu.cn
  • Introduction:张浩鹏(1986— ),男,讲师,研究方向为目标三维姿态测量的理论和应用。E-mail:hangpengzhang@buaa.edu.cn
ZHANG Haopeng12*,  
  • Affiliation:

    School of Astronautics, Beihang University, Beijing 100191, China

    Beijing Key laboratory of Digital Media, Beijing 100191, China

CAI Bowen12,  
  • Affiliation:

    School of Astronautics, Beihang University, Beijing 100191, China

    Beijing Key laboratory of Digital Media, Beijing 100191, China

LUO Penghao12

реферат

Hyperspectral remote sensing image classification is one of the enormous challenges in the field of applied remote sensing. Traditionally, supervised methods, such as Support Vector Machine (SVM), dominate this area. Especially, Conditional Random Field (CRF) excels in solving this kind of problem in most cases, due to its prominent ability in formulating the spatial relationship. However, CRF suffers from the availability of large amount of labeled samples, which is labor- and time-consuming to obtain in practice. The accuracy tends to decrease dramatically once labeled samples are not adequate or informative enough. To solve the above problem, a semi-supervised CRF model is proposed in this paper. In the semi-supervised CRF model, the association potential is defined as the spatio-spectral Laplacian Support Vector Machine (ssLapSVM), to exploit the information contained in the unlabeled samples. And the multi-class probability for each sample is obtained by the ssLapSVM with the one-versus-one scheme. In addition, the interaction potential is newly designed by introducing a weight into the Potts model. Note that, in the classification of hyperspectral remote sensing with limited labeled samples, unlabeled neighbors of one labeled samples may often exist. Thus, the labels of these unlabeled neighbors are assigned based on maximum probability acquired by the ssLapSVM, and use the maximum probability as a weight. In the training phrase, the optimal parameters in the association potential, i.e. ssLapSVM, is firstly trained, and then the whole semi-supervised CRF model is trained to get the optimal parameters in the interaction potential. In the inference phrase, mean-field is adopted to find the optimal label configuration over the testing set. The performance of the proposed semi-supervised CRF model is evaluated on two well-known benchmarks, i.e. Indian Pines scene and Pavia University scene. The objective comparison experiments are carried out among some state-of-the-art methods in terms of kappa statistic. On both Indian Pines (IP) scene and Pavia University (PU) scene, the proposed method can exhibits completely better performance, improve by 4.94%@IP and 3.28%@PU, respectively. In addition, the kappa of the proposed method rises with the increase of the number of labeled training samples. And in most cases, the proposed method shows better performance than other contrast methods under the case of the same training labeled samples. With the increase of trade-off coefficient, kappa statistic rise first and tend to steady, and then degrades dramatically. The proposed method also shows better performance when the larger scope of samples participating in the construction of the interaction potential. In this paper, we have developed a semi-supervised CRF to address the problem of hyperspectral image classification. Our method can effectively improve the kappa statistic under limited labeled-training set by newly designed association and interaction potential. Experiments conducted on two well-known hyperspectral datasets demonstrate the effectiveness of the proposed method. And when compared to related semi-supervised algorithms, the proposed method shows its superiority.

ключеви́че слова́

hyperspectral;remote sensing;classification;semi-supervised;conditional random field

References

  1. 1.
    Ablin R and Sulochana C H. 2013. A survey of hyperspectral image classification in remote sensing. International Journal of Advanced Research in Computer and Communication Engineering, 2(8): 2986–3000
  2. 2.
    Du P J, Xia J S, Xue C H, Tan K, Su H J and Bao R. 2016. Review of hyperspectral remote sensing image classification. Journal of Remote Sensing, 20(2): 236–256
  3. 3.
    Espínola M, Piedra-Fernández J A, Ayala R, Iribarne L and Wang J Z. 2015. Contextual and hierarchical classification of satellite images based on cellular automata. IEEE Transactions on Geoscience and Remote Sensing, 53(2): 795–809
  4. 4.
    Fauvel M, Benediktsson J A, Chanussot J and Sveinsson J R. 2008. Spectral and spatial classification of hyperspectral data using SVMs and morphological profiles. IEEE Transactions on Geoscience and Remote Sensing, 46(11): 3804–3814
  5. 5.
    Geng B, Tao D C, Xu C, Yang L J and Hua X S. 2012. Ensemble manifold regularization. IEEE Transactions on Pattern Analysis and Machine Intelligence, 34(6): 1227–1233
  6. 6.
    Gomez-Chova L, Camps-Valls G, Munoz-Mari J and Calpe J. 2008. Semisupervised image classification with laplacian support vector machines. IEEE Geoscience and Remote Sensing Letters, 5(3): 336–340
  7. 7.
    Gu Y F and Feng K. 2013. Optimized laplacian SVM with distance metric learning for hyperspectral image classification. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 6(3): 1109–1117
  8. 8.
    Kae A, Sohn K, Lee H and Learned-Miller E. 2013. Augmenting CRFs with boltzmann machine shape priors for image labeling//Proceeding of 2013 IEEE Conference on Computer Vision and Pattern Recognition. Portland, OR, USA: IEEE: 2019–2026 [DOI: 10.1109/CVPR.2013.263]
  9. 9.
    Lafferty J D, McCallum A and Pereira F C N. 2001. Conditional random fields: probabilistic models for segmenting and labeling sequence data//Proceedings of 18th International Conference on Machine Learning (ICML). San Francisco, CA, USA: Morgan Kaufmann Publishers Inc.: 282–289
  10. 10.
    Li Z C, Ma J W, Zhang R and Li L W. 2011. Classifying hyperspectral data using support vector machine conditional random field. Geomatics and Information Science of Wuhan University, 36(3): 306–310
  11. 11.
    Melgani F and Bruzzone L. 2004. Classification of hyperspectral remote sensing images with support vector machines. IEEE Transactions on Geoscience and Remote Sensing, 42(8): 1778–1790
  12. 12.
    Sun L, Wu Z B, Liu J J, Xiao L and Wei Z H. 2015. Supervised spectral-spatial hyperspectral image classification with weighted markov random fields. IEEE Transactions on Geoscience and Remote Sensing, 53(3): 1490–1503
  13. 13.
    Tong Q X, Zhang B and Zheng L F. 2006. Hyperspectral Remote Sensing: the Principle, Technology and Application. Beijing: Higher Education Press: 1–2
  14. 14.
    Wang L G, Yang Y S and Liu D F. 2016. Semi-supervised classification for hyperspectral image based on improved tri-training method. Journal of Harbin Engineering University, 37(6): 849–854
  15. 15.
    Xia J S, Chanussot J, Du P J and He X Y. 2014. (Semi-) supervised probabilistic principal component analysis for hyperspectral remote sensing image classification. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 7(6): 2224–2236
  16. 16.
    Yang G P, Yu X C, Chen W and Liu W. 2008. Hyperspectral remote sensing image classification based on kernel fisher discriminant analysis. Journal of Remote Sensing, 12(4): 579–585
  17. 17.
    Yang L X, Yang S Y, Jin P L and Zhang R. 2014. Semi-supervised hyperspectral image classification using Spatio-spectral Laplacian support vector machine. IEEE Geoscience and Remote Sensing Letters, 11(3): 651–655
  18. 18.
    Zhong P and Wang R S. 2008. Learning sparse CRFs for feature selection and classification of hyperspectral imagery. IEEE Transactions on Geoscience and Remote Sensing, 46(12): 4186–4197
  19. 19.
    Zhong P and Wang R S. 2010. Learning conditional random fields for classification of hyperspectral images. IEEE Transactions on Image Processing, 19(7): 1890–1907
  20. 20.
    Zhong P and Wang R S. 2014. Jointly learning the hybrid CRF and MLR model for simultaneous denoising and classification of hyperspectral imagery. IEEE Transactions on Neural Networks and Learning Systems, 25(7): 1319–1334
  21. 21.
    Zhong Y F, Lin X M and Zhang L P. 2014. A support vector conditional random fields classifier with a mahalanobis distance boundary constraint for high spatial resolution remote sensing imagery. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 7(4): 1314–1330

Читать полностью

The above content is generated by Large Model Translation. The translated content is for reference only. We do not assume any commercial or legal responsibilty for any consequences arising from the use of our website