سابِق|تال

Optimized SVM based on artificial bee colony algorithm for remote sensing image classification

  • role： First author第一作者
  • Email：lena@mail.bnu.edu.cn
  • Introduction：李楠，1992年生，女，博士研究生，研究方向为农业遥感。E-mail： lena@mail.bnu.edu.cn
Nan LI,  
  • role： Corresponding author通信作者
  • Email：zhuxiufang@bnu.edu.cn
  • Introduction：朱秀芳，1982年生，女，副教授，研究方向为农业遥感。E-mail： zhuxiufang@bnu.edu.cn
Xiufang ZHU*,  
  • No information about the author is available
Yaozhong PAN,  
  • No information about the author is available
Pei ZHAN

ملخص

In the applications of a Support Vector Machine (SVM) classifier in solving classification problems, setting model parameters significantly influence the classification result, which causes a necessity for optimizing the key factors (cost and kernel parameters) in the SVM classifier to obtain the optimal classification results. Artificial Intelligence (AI) methods, which provide solutions for the parameter optimization problem of the SVM classifier, have emerged in recent years with the rapid advancement of the AI technology. However, these methods can easily trap the local optimal solution during the optimization process. An Artificial Bee Colony (ABC) algorithm exerts advantages, such as fast convergence and uneasiness of falling into a local optimum. Therefore, this study is aimed at introducing the ABC algorithm into optimizing the key parameters of the SVM classifier, thereby attempting to achieve a high precision in remote sensing image classification. The ABC algorithm imitates the behavior of honey bees in searching for the optimal parameters (also referred as the nectar) in the SVM classifier. The quality of the parameters is continuously validated using a threefold cross-validation accuracy of the training samples until The quality of parameters reaches the maximum accuracy. Then, the SVM with the optimized parameters are applied to classify the remote sensing images. First, three types of SVM classifier, namely, SVM optimized by an ABC algorithm (ABC-SVM), SVM optimized by a genetic algorithm (GA-SVM), and SVM optimized by a particle swarm algorithm (PSO-SVM), were compared when classifying five standard UCI datasets to verify the classification accuracy and efficiency of the ABC-SVM. The operation efficiency of the three AI algorithms was compared in the classification experiment based on the same UCI dataset, during which the training time and convergence curve of the three algorithms were recorded. Results showed that the ABC-SVM method has the highest classification accuracy, which is 6.55% and 6.07% higher than that of the GA-SVM and PSO-SVM algorithms, respectively. In terms of the efficiency of the three AI algorithms, the GA-SVM and PSO-SVM undergo minimal training time in the classification experiments of the five datasets. However, their global searching capability is inefficient, and the convergence rates are slow. The ABC-SVM undergoes the longest operation time among the three AI algorithms, but its fitness value is the highest and the convergence rate the fastest. Then, classification accuracies were evaluated based on a remote sensing image in the test area (Landsat-8 OLI image in Huairou area, Beijing), in which the SVMs were optimized by the three AI algorithms, and the original SVMs were compared. Results showed that the ABC-SVM method has the highest classification accuracy, which is 10.50% higher than that of the original SVM classification algorithm and is 1.67% and 1.50% higher than those of the other two AI algorithms (GA-SVM and PSO-SVM, correspondingly). The conclusions are listed as follows: (1) The ABC-SVM shows the highest classification accuracy among the results of the three types of AI optimized using the SVM algorithm when classifying the UCI datasets. The average classification accuracy of the five datasets is 6.55% and 6.07% higher than that of the GA-SVM and PSO-SVM, respectively. In addition, ABC-SVM has the fastest convergence among the three AI methods and shows a complex trapping local optimum. (2) The results of using the remote sensing image to verify the accuracy of the four classification algorithms show that the average accuracy of the SVM optimized by the three AI algorithms is 9.45% higher than the original SVM algorithm. Among these AI algorithms, the classification accuracy is 1. 67% and 1.50% higher in the ABC-SVM than in the GA-SVM and PSO-SVM, respectively.

مفهوم

artificial bee colony algorithm;Support Vector Machine (SVM);remote sensing image;classification

References

  1. 1.
    Akay B and Karaboga D. 2012. A modified artificial bee colony algorithm for real-parameter optimization. Information Sciences, 192: 120–142
  2. 2.
    Benala T R, Villa S H, Jampala S D and Konathala B. 2009. A novel approach to image edge enhancement using artificial bee colony optimization algorithm for hybridized smoothening filters//Proceedings of World Congress on Nature and Biologically Inspired Computing. Coimbatore, India: IEEE: 1071–1076 [DOI: 10.1109/NABIC.2009.5393866]
  3. 3.
    Blake C and Merz C J. 1998. UCI machine learning repository[EB/OL].[2017-06-02])
  4. 4.
    Chang C C and Lin J C. 2011. LIBSVM: a library for support vector machines. ACM Transactions on Intelligent Systems and Technology, 2(3): 27
  5. 5.
    Chapelle O, Vapnik V, Bousquet O and Mukherjee S. 2002. Choosing multiple parameters for support vector machines. Machine Learning, 46(1/3): 131–159
  6. 6.
    Chipperfield A J, Fleming P J and Fonseca C M. 1994. Genetic algorithm tools for control systems engineering//Proceedings of Adaptive Computing in Engineering Design and Control. Plymouth, UK: PlymouthEngineering Design Centre: 128–133.
  7. 7.
    Cortes C and Vapnik V. 1995. Support-vector networks. Machine Learning, 20(3): 273–297
  8. 8.
    Hsu C W, Chang C C and Lin C J. 2003. A Practical Guide to Support Vector Classification. Taipei, China: National Taiwan University.
  9. 9.
    Huang C L and Wang C J. 2006. A GA-based feature selection and parameters optimizationfor support vector machines. Expert Systems with Applications, 31(2): 231–240
  10. 10.
    Jia K, Li Q Z, Tian Y C and Wu B F. 2011. A review of classification methods of remote sensing imagery. Spectroscopy and Spectral Analysis, 31(10): 2618–2623 (
  11. 11.
    Jiang M Y and Yuan D F. 2014. Artificial Bee Colony Algorithm and its Application. Beijing: Science Press
  12. 12.
    Karaboga D. 2005. An Idea Based on Honey Bee Swarm for Numerical Optimization. Kayseri, Turkey: Erciyes University, Engineering Faculty
  13. 13.
    Karaboga D and Basturk B. 2008. On the performance of artificial bee colony (ABC) algorithm. Applied Soft Computing, 8(1): 687–697
  14. 14.
    Karaboga D, Gorkemli B, Ozturk C and Karaboga N. 2014. A comprehensive survey: artificial bee colony (ABC) algorithm and applications. Artificial Intelligence Review, 42(1): 21–57
  15. 15.
    Karaboga D and Ozturk C. 2011. A novel clustering approach: artificial bee colony (ABC) algorithm. Applied Soft Computing, 11(1): 652–657
  16. 16.
    Kavzoglu T and Colkesen I. 2009. A kernel functions analysis for support vector machines for land cover classification. International Journal of Applied Earth Observation and Geoinformation, 11(5): 352–359
  17. 17.
    Linh N T and Anh N Q. 2010. Application artificial bee colony algorithm (ABC) for reconfiguring distribution network//Proceedings of the 2nd International Conference on Computer Modeling and Simulation. Sanya, China: IEEE: 102–106 [DOI: 10.1109/ICCMS.2010.306]
  18. 18.
    Liu J X, Jia Z H, Qin X Z, Chang C and Wang H. 2013. Applications in channel assignment based on improved artificial bee colony algorithm. Computer Engineering and Applications, 49(7): 119–122 (
  19. 19.
    Liu S and Li Y Y. 2007. Parameter selection algorithm for support vector machines based on adaptive genetic algorithm. Journal of Harbin Engineering University, 28(4): 398–402 (
  20. 20.
    Lu N, Zhou J Z, He Y Y and Liu Y. 2009. Particle swarm optimization for parameter optimization of support vector machine model//Proceedings of the 2nd International Conference on Intelligent Computation Technology and Automation. Changsha, China: IEEE: 283–286 [DOI: 10.1109/ICICTA.2009.76]
  21. 21.
    Luo J C, Zhou C H, Liang Y and Ma J H. 2002. Support vector machine for spatial feature extraction and classification of remotely sensed imagery. Journal of Remote Sensing, 6(1): 50–55 (
  22. 22.
    Ranaee V, Ebrahimzadeh A and Ghaderi R. 2010. Application of the PSO–SVM model for recognition of control chart patterns. ISA Transactions, 49(4): 577–586
  23. 23.
    Roli F and Fumera G. 2001. Support vector machines for remote sensing image classification//Processing of SPIE 4170, Image and Signal Processing for Remote Sensing VI. Barcelona, Spain: SPIE: 160–166 [DOI: 10.1117/12.413892]
  24. 24.
    Stone M. 1974. Cross-validatory choice and assessment of statistical predictions. Journal of the Royal Statistical Society. Series B (Methodological), 36(2): 111–147
  25. 25.
    Taşpņar N, Karaboğa D, Yıldırım M and Akay B. 2011. Partial transmit sequences based on artificial bee colony algorithm for peak-to-average power ratio reduction in multicarrier code division multiple access systems. IET Communications, 5(8): 1155–1162
  26. 26.
    Wilkinson G G. 2005. Results and implications of a study of fifteen years of satellite image classification experiments. IEEE Transactions on Geoscience and Remote Sensing, 43(3): 433–440
  27. 27.
    Xiao Y H and Yu W Y. 2010. Bee colony algorithm for image edge detection. Application Research of Computers, 27(7): 2748–2750 (
  28. 28.
    Zeng J C, Jie J and Cui Z H. 2004. Particle Swarm Optimization. Beijing: Science Press
  29. 29.
    Zhang J S, He C Y, Pan Y Z and Li J. 2006. The high spatial resolution RS image classification based on SVM method with the multi-source data. Journal of Remote Sensing, 10(1): 49–57 (
  30. 30.
    Zhang X L, Chen X F and He Z J. 2010. An ACO-based algorithm for parameter optimization of support vector machines. Expert Systems with Applications, 37(9): 6618–6628

قراءة النص الكامل

The above content is generated by Large Model Translation. The translated content is for reference only. We do not assume any commercial or legal responsibilty for any consequences arising from the use of our website