Früher|Nächster

Dynamic ensemble algorithm of SMOTE and rotation forest for imbalanced hyperspectral remote sensing classification

  • role： First author第一作者
  • Affiliation：

    School of Electronic Engineering, Xidian University, Xi’an 710071, China

    Research Institute of Advanced Remote Sensing Technology, Xidian University, Xi’an 710071, China

  • Email：yptong@stu.xidian.edu.cn
  • Introduction：童莹萍，研究方向为遥感图像处理。E-mail：yptong@stu.xidian.edu.cn
TONG Yingping12,  
  • role： Corresponding author通信作者
  • Affiliation：

    School of Electronic Engineering, Xidian University, Xi’an 710071, China

    Research Institute of Advanced Remote Sensing Technology, Xidian University, Xi’an 710071, China

  • Email：wfeng@xidian.edu.cn
  • Introduction：冯伟，研究方向为遥感图像处理、机器学习。E-mail：wfeng@xidian.edu.cn
FENG Wei12*,  
  • Affiliation：

    School of Electronic Engineering, Xidian University, Xi’an 710071, China

    Research Institute of Advanced Remote Sensing Technology, Xidian University, Xi’an 710071, China

SONG Yijia12,  
  • Affiliation：

    School of Electronic Engineering, Xidian University, Xi’an 710071, China

    Research Institute of Advanced Remote Sensing Technology, Xidian University, Xi’an 710071, China

QUAN Yinghui12,  
  • Affiliation：

    Key Laboratory of Digital Earth Science, Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100094, China

HUANG Wenjiang3,  
  • Affiliation：

    Key Laboratory of Digital Earth Science, Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100094, China

GAO Lianru3,  
  • Affiliation：

    School of Electronic Engineering, Xidian University, Xi’an 710071, China

    Research Institute of Advanced Remote Sensing Technology, Xidian University, Xi’an 710071, China

ZHU Wentao12,  
  • Affiliation：

    Academy of Advanced Interdisciplinary Research, Xidian University, Xi’an 710071, China

XING Mengdao4

Resümee

Rotation Forest (RoF), a powerful ensemble classifier, has obtained many successful applications in hyperspectral image classification. However, the data often has the problem of class imbalance. Consequently, the traditional RoF algorithm focuses on identifying the classes with majority samples, ignoring the accuracy of minority samples. The SMOTE (Synthetic Minority Oversampling Technique) algorithm increases the number of minority samples by simulating the way of generating new samples, thereby achieving the effect of balancing the categories of the data set. However, the SMOTE algorithm is mainly used in the data preprocessing stage and has the risk of increasing artificial noise when dealing with multi-class problems. Therefore, a novel dynamic ensemble algorithm based on SMOTE and RoF is proposed in this work to increase the classification accuracy of the multi-class imbalanced hyperspectral data. The proposed algorithm uses a dynamic sampling factor technology to merge the class distribution optimization with the base classifier. This algorithm not only realizes the adaptive generation of class balance data set but also reduces the influence of noise on the base classifier. In this experiment, three public hyperspectral images are used to test the performance of the algorithm, They are Indian Pines, Salinas and Pavia University. Four comparison algorithms are also selected, including random forest, traditional RoF, RoF algorithm with random oversampling, and SMOTE data preprocessing. The overall accuracy, average accuracy, F-measure, Gmean, minimum recall rate, ensemble classifier diversity, model training time, and McNemar test are the algorithm evaluation criteria. The experimental results demonstrate the effectiveness of the proposed method. The novel method not only obtains obvious classification advantages but also increases the recognition accuracy of minority samples while maintaining the overall classification accuracy of the data.

Schlüsselwort

ensemble learning;imbalanced classification;rotation forest;SMOTE;dynamic sampling

References

  1. 1.
    Arshad A, Riaz S and Jiao L C. 2019. Semi-supervised deep fuzzy C-mean clustering for imbalanced multi-class classification. IEEE Access, 7: 28100-28112
  2. 2.
    Bandara A, Hettiarachchi Y, Hettiarachchi K, Munasinghe S, Wijesinghe I, Kusal H, Sidath M, Ishara W and Thayasivam U. 2020. A generalized ensemble machine learning approach for landslide susceptibility modeling//Sharma N, Chakrabarti A and Balas V E eds. Data Management, Analytics and Innovation. Singapore: Springer, 1016: 71-93
  3. 3.
    Bhagat R C and Patil S S. 2015. Enhanced SMOTE algorithm for classification of imbalanced big-data using Random Forest//2015 IEEE International Advance Computing Conference (IACC). Banglore: IEEE
  4. 4.
    Breiman L. 2001. Random Forests. Machine Learning, 45: 5-32
  5. 5.
    Cai L and Zhang G. 2019. Hyperspectral image classification with imbalanced data based on oversampling and convolutional neural network//Proceedings of SPIE 11342, AOPC 2019: AI in Optics and Photonics. Beijing: SPIE: 11342 [DOI: 10.1117/12.2543458]
  6. 6.
    Cai Z X, Wang X Y, Xu J and Jing L P. 2019. Sample adaptive classifier for imbalanced data. Computer Science, 46(1): 94-99
  7. 7.
    Díez-Pastor J F, Rodríguez J J, García-Osorio C I and Kuncheva L I. 2015. Diversity techniques improve the performance of the best imbalance learning ensembles. Information Sciences, 325: 98-117
  8. 8.
    Douzas G, Bacao F and Last F. 2018. Improving imbalanced learning through a heuristic oversampling method based on k-means and SMOTE. Information Sciences, 465: 1-20
  9. 9.
    Du P J, Xia J S, Xue Z H, Tan K, Su H J and Bao R. 2016. Review of hyperspectral remote sensing image classification. Journal of Remote Sensing, 20(2): 236-256
  10. 10.
    Elreedy D and Atiya A F. 2019. A comprehensive analysis of Synthetic Minority Oversampling Technique (SMOTE) for handling class imbalance. Information Sciences, 505: 32-64
  11. 11.
    Feng W and Bao W X. 2017. Weight-based rotation forest for hyperspectral image classification. IEEE Geoscience and Remote Sensing Letters, 14(11): 2167-2171
  12. 12.
    Feng W, Boukir S and Huang W. 2019a. Margin-based random forest for imbalanced land cover classification//2019 IEEE International Geoscience and Remote Sensing Symposium. Yokohama: IEEE: 3085-3088
  13. 13.
    Feng W, Dauphin G, Huang W J, Quan Y H and Liao W Z. 2019b. New margin-based subsampling iterative technique in modified random forests for classification. Knowledge-Based Systems, 182: 104845
  14. 14.
    Feng W, Huang W J and Ren J C. 2018. Class imbalance ensemble learning based on the margin theory. Applied Sciences, 8(5): 815
  15. 15.
    Gao L R, Zhang B, Zhang X and Shen X. 2007. Study on the method for estimating the noise in remote sensing images based on local standard deviations. Journal of Remote Sensing, 2007,11, (2): 201-208
  16. 16.
    García S, Zhang Z L, Altalhi A, Alshomrani S and Herrera F. 2018. Dynamic ensemble selection for multi-class imbalanced datasets. Information Sciences, 445-446: 22-37
  17. 17.
    Ghosh D and Cabrera J. Enriched random forest for high dimensional genomic data. IEEE/ACM Transactions on Computational Biology and Bioinformatics, 1-1
  18. 18.
    Han Z, Gao L R, Zhang B, Sun X and Li Q T. 2020. Nonlinear hyperspectral unmixing algorithm based on deep autoencoder networks. Journal of Remote Sensing, 24(4): 388-400
  19. 19.
    Jimenez-Castaño C, Alvarez-Meza A and Orozco-Gutierrez A. 2020. Enhanced automatic twin support vector machine for imbalanced data classification. Pattern Recognition, 107: 107442
  20. 20.
    Krawczyk B. 2016. Learning from imbalanced data: open challenges and future directions. Progress in Artificial Intelligence, 5(4): 221-232
  21. 21.
    Mullick S S, Datta S, Dhekane S G and Das S. 2020. Appropriateness of performance indices for imbalanced data classification: an analysis. Pattern Recognition, 102: 107197
  22. 22.
    Pan T T, Zhao J H, Wu W and Yang J. 2020. Learning imbalanced datasets based on SMOTE and Gaussian distribution. Information Sciences, 512: 1214-1233
  23. 23.
    Rodríguez J J, Díez-Pastor J F, Arnaiz-González Á and Kuncheva L I. 2020. Random Balance ensembles for multiclass imbalance learning. Knowledge-Based Systems, 193: 105434
  24. 24.
    Rodriguez J J, Kuncheva L I and Alonso C J. 2006. Rotation forest: a new classifier ensemble method. IEEE Transactions on Pattern Analysis and Machine Intelligence, 28(10): 1619-1630
  25. 25.
    Tu X, Shen X B, Fu P, Wang T, Sun Q S and Ji Z X. 2020. Discriminant sub-dictionary learning with adaptive multiscale superpixel representation for hyperspectral image classification. Neurocomputing, 409: 131-145
  26. 26.
    Zhang Y Q, Lu R Z, Qiao S J, Han N, Gutierrez L A and Zhou J L. 2020. A sampling method of imbalanced data based on sample space. Acta Automatica Sinica，1-14
  27. 27.
    Zhou G and Guo F L. 2019. Research on sampling diversity method in ensemble learning base on margin//2019 International Conference on Machine Learning, Big Data and Business Intelligence (MLBDBI). Taiyuan: Shanxi University of Finance and Economics and hosted by AEIC Academic Exchange Center : 316-319
  28. 28.
    Zhou S, Sun L J, Xing W, Feng G J, Ji Y M, Yang J and Liu S C. 2020. Hyperspectral imaging of beet seed germination prediction. Infrared Physics & Technology, 108: 10336

Lesen Sie die ganze Passage

The above content is generated by Large Model Translation. The translated content is for reference only. We do not assume any commercial or legal responsibilty for any consequences arising from the use of our website