Précédent|Prochain

Regional multiscale Markov random field for remote sensing image classification

  • role： First author第一作者
  • Affiliation：

    School of Printing and Packaging, Wuhan University, Wuhan 430079，China

    School of Design, Southwest Forestry University, Kunming 650224, China

  • Email：daiqinling@126.com
  • Introduction：代沁伶，1982年生,女，博士研究生, 研究方向为数字图像处理及遥感应用。E-mail: daiqinling@126.com
DAI Qinling12,  
  • role： Corresponding author通信作者
  • Affiliation：

    State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan;University, Wuhan 430079, China

  • Email：luob@whu.edu.cn
  • Introduction：罗斌，1980年生,男，教授，研究方向为遥感影像分析。E-mail:luob@whu.edu.cn
LUO Bin3*,  
  • Affiliation：

    School of Mathematics and Statistics, Henan University, Kaifeng 475000, China

ZHENG Chen4,  
  • Affiliation：

    Institutes of Big Data and Artificial Intelligence, Southwest Forestry University, Kunming 650224, China

    Key Laboratory of State Forestry Administration on Forestry and Ecological Big Data, Southwest Forestry University, Kunming 650224, China

WANG Leiguang56

résumé

Multiscale analysis technique can describe an image from different resolutions and has been widely used for extracting features and modelling of remotely sensed images. The subsampled wavelet transforms are commonly employed for establishing the multiscale representation of an image. However, the wavelet-based features cannot describe patterns with long spatial spans and often result in noisy classification results. By contrast, the object-based image analysis can create classification maps composed of compact land objects. However, features extracted from a single scale still cannot provide discriminating information for the land cover classification. To improve the classification accuracy and alleviate noisy thematic maps, a regional multiscale classification method is proposed.The proposed method consists of two main blocks, including establishing a regional multiscale image representation and classifying on the basis of Markov Random Field (MRF). In the first block, the mean shift segmentation method is employed to create initial over-segmented regions. Thereafter, a rule combining the grey values in the regions and the shared boundary lengths among regions is designed to extract the low-frequency part of an image. The current high-frequency part is obtained by subtracting the original image and the current low-frequency portion. A regional multiscale representation can be iteratively established by replacing the original image with the low-frequency part and repeating the segmenting and decomposing process. In the second block, the classification result obtained from the original image is considered the prior of the label field in the first decomposed level, and the high-frequency part in the first level models the feature field of MRF. The classification result in the first level is obtained by solving an objective function consisting of feature and label energies. By iteratively projecting the current classification result to the next level and modelling the feature field with the high-frequency part, the final classification map can be acquired in the coarsest scale.To examine the effectiveness of the proposed method, three groups (six images in total), such as Prague textures, synthetic remote sensing textures, and QuickBird multispectral images, are adopted. The proposed regional multiscale MRF (RMRF) is compared with the Iterated Conditional Model (ICM), Graph Cut (GC), and Wavelet-based MRF classification methods (WMRF). Visual inspection and quantitative measurement are employed for the comparison. As GC fails to integrate the spatial information among neighbouring pixels, the classification results are dominated by the pixel spectral values. Textures or land cover patterns with complex spectral heterogeneity cannot be properly captured. WMRF provides a pixel-level multiscale representation, which is also insufficient for describing texture patterns across a large spatial span. ICM, GC and WMRF may create noisy thematic maps with different extensions when the spectral heterogeneity of a given land cover pattern is extreme. On the contrary, RMRF has a flexible framework to extract and model spatial information. RMF can capture the essential features of land objects with large spectral heterogeneity, resulting in maps with less noise.This study proposes an RMRF for classification. Experiments demonstrate that the established multiscale representation can efficiently describe texture patterns with wide spatial spans, such as land objects with complex structures. By combining the multiscale representation with MRF model, RMRF can achieve a high-precision semantic segmentation of ground objects. The adaptive estimation of the decomposition layer number and parameters of the algorithm are the on-going works.

mots-clés

high resolution remote sensing;image classifications;regional segmentation;Markov random field;multiscale model

References

  1. 1.
    Benediktsson J A, Pesaresi M and Amason K. 2003. Classification and feature extraction for remote sensing images from urban areas based on morphological transformations. IEEE Transactions on Geoscience and Remote Sensing, 41(9): 1940-1949
  2. 2.
    Besag J. 1986. On the statistical analysis of dirty pictures. Journal of the Royal Statistical Society: Series B (Methodological), 48(3): 259-279
  3. 3.
    Blaschke T. 2010. Object based image analysis for remote sensing. ISPRS Journal of Photogrammetry and Remote Sensing, 65(1): 2-16
  4. 4.
    Boykov Y, Veksler O and Zabih R. 2001. Fast approximate energy minimization via graph cuts. IEEE Transactions on Pattern Analysis and Machine Intelligence, 23(11): 1222-1239
  5. 5.
    Chang C C and Lin C J. 2011. LIBSVM: a library for support vector machines. ACM Transactions on Intelligent Systems and Technology, 2(3): 27
  6. 6.
    Cohen J. 1960. A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20(1): 37-46
  7. 7.
    Comaniciu D and Meer P. 2002. Mean shift: a robust approach toward feature space analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence, 24(5): 603-619
  8. 8.
    Gislason P O, Benediktsson J A and Sveinsson J R. 2006. Random forests for land cover classification. Pattern Recognition Letters, 27(4): 294-300
  9. 9.
    Gong P, Li X and Xu B. 2006. Interpretation theory and application method development for information extraction from high resolution remotely sensed data. Journal of Remote Sensing, 10(1): 1-5
  10. 10.
    Gong P. 2009. Some essential questions in remote sensing science and technology. Journal of Remote Sensing, 13(1): 1-23
  11. 11.
    Huang X, Zhang L P and Li P X. 2007. An adaptive multiscale information fusion approach for feature extraction and classification of IKONOS multispectral imagery over urban areas. IEEE Geoscience and Remote Sensing Letters, 4(4): 654-658
  12. 12.
    Li N, Huo H and Fang T. 2010. A novel texture-preceded segmentation algorithm for high-resolution imagery. IEEE Transactions on Geoscience and Remote Sensing, 48(7): 2818-2828
  13. 13.
    Li S Z. 2009. Markov Random Field Modeling in Image Analysis. 3rd ed. London: Springer-Verlag
  14. 14.
    Long J, Shelhamer E and Darrell T. 2015. Fully convolutional networks for semantic segmentation//Proceedings of 2015 Computer Vision and Pattern Recognition. Boston, MA, USA: IEEE: 3431-3440
  15. 15.
    Malfait M and Roose D. 1997. Wavelet-based image denoising using a Markov random field a priori model. IEEE Transactions on Image Processing, 6(4): 549-565
  16. 16.
    Marmanis D, Schindler K, Wegner J D, Galliani S, Datcu M and Stilla U. 2018. Classification with an edge: improving semantic image segmentation with boundary detection. ISPRS Journal of Photogrammetry and Remote Sensing, 135: 158-172
  17. 17.
    Mikeš S, Haindl M, Scarpa G and Gaetano R. 2015. Benchmarking of remote sensing segmentation methods. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 8(5): 2240-2248
  18. 18.
    Moser G, Serpico S B and Benediktsson J A. 2013. Land-cover mapping by Markov modeling of spatial-contextual information in very-high-resolution remote sensing images. Proceedings of the IEEE, 101(3): 631-651
  19. 19.
    Noda H, Shirazi M N and Kawaguchi E. 2002. MRF-based texture segmentation using wavelet decomposed images. Pattern Recognition, 35(4): 771-782
  20. 20.
    Wang L G, Dai Q L, Xu Q Z and Zhang Y. 2015. Constructing hierarchical segmentation tree for feature extraction and land cover classification of high resolution MS imagery. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 8(5): 1946-1961
  21. 21.
    Wang L G, Cao X W, Zheng Y L and Dai Q L. 2018. Multi-scale feature extraction of hyperspectral image with guided filtering. Journal of Remote Sensing, 22(2): 293-303
  22. 22.
    Yu Q Y and Clausi D A. 2008. IRGS: Image segmentation using edge penalties and region growing. IEEE Transactions on Pattern Analysis and Machine Intelligence, 30(12): 2126-2139
  23. 23.
    Zhang G and Ma Z M. 2010. An approach of using gabor wavelets for texture feature extraction. Journal of Image and Graphics, 15(2): 247-254
  24. 24.
    Zhang L and Ji Q. 2010. Image segmentation with a unified graphical model. IEEE Transactions on Pattern Analysis and Machine Intelligence, 32(8): 1406-1425
  25. 25.
    Zheng C and Wang L G. 2015. Semantic segmentation of remote sensing imagery using object-based markov random field model with regional penalties. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 8(5): 1924-1935
  26. 26.
    Zheng C, Zhang Y and Wang L G. 2017. Semantic segmentation of remote sensing imagery using an object-based Markov random field model with auxiliary label fields. IEEE Transactions on Geoscience and Remote Sensing, 55(5): 3015-3028

Lire l'article complet

The above content is generated by Large Model Translation. The translated content is for reference only. We do not assume any commercial or legal responsibilty for any consequences arising from the use of our website