Précédent|Prochain

Improvement in recognition accuracy of minority crops by resampling of imbalanced training datasets of remote sensing

  • role： First author第一作者
  • Affiliation：

    Institute of Remote Sensing and Digital Earth, Chinese Academy of Sciences, Beijing 100101, China

    College of Resources and Environmental Sciences of University of Chinese Academy of Sciences, Beijing 100049, China

  • Email：fandd@radi.ac.cn
  • Introduction：樊东东，1992年生，男，硕士研究生，研究方向为农业遥感分类、空间数据挖掘。E-mail：fandd@radi.ac.cn
FAN Dongdong12,  
  • role： Corresponding author通信作者
  • Affiliation：

    Institute of Remote Sensing and Digital Earth, Chinese Academy of Sciences, Beijing 100101, China

  • Email：liqz@radi.ac.cn
  • Introduction：李强子，1970年生，男，研究员，研究方向为农业遥感与生态遥感。E-mail：liqz@radi.ac.cn
LI Qiangzi1*,  
  • Affiliation：

    Institute of Remote Sensing and Digital Earth, Chinese Academy of Sciences, Beijing 100101, China

WANG Hongyan1,  
  • Affiliation：

    Institute of Remote Sensing and Digital Earth, Chinese Academy of Sciences, Beijing 100101, China

ZHANG Yuan1,  
  • Affiliation：

    Institute of Remote Sensing and Digital Earth, Chinese Academy of Sciences, Beijing 100101, China

DU Xin1,  
  • Affiliation：

    Institute of Remote Sensing and Digital Earth, Chinese Academy of Sciences, Beijing 100101, China

    College of Resources and Environmental Sciences of University of Chinese Academy of Sciences, Beijing 100049, China

SHEN Yu12

résumé

The rapid development of high-spatial-resolution satellites has effectively alleviated the problem of mixed pixels in satellite images, thereby enabling extraction of the meticulous distribution of crops from them. The classification of remote sensing images is a quick way to obtain accurate agricultural information. However, the accuracy of supervised classification using remote sensing images is affected by several factors, such as classifier algorithm and input datasets. The imbalanced training samples, which indicates the number of training samples of some categories is considerably smaller or larger than the others, often results in poor classification accuracy for the minority classes. To improve this situation and generalization performance of classifier, this research focused on proper utilization of resampling techniques and classification methodologies for achieving perfect performance of remote sensing image classification. We investigated the aforementioned images by data mining approaches including spectrum and texture features and selection of optimized features based on recursive feature elimination. Then, five resample methods, namely, three over-resampling methods and two under-sampling methods, were separately used to balance the initial training datasets. Finally, we tested the resampled datasets by utilizing two classifiers (decision tree and AdaBoost) and evaluated the performance of each one in terms of kappa coefficient, overall accuracy, producer’s accuracy, and user’s accuracy. The overall classification accuracy and kappa coefficient improved considerably on decision tree (14.32%) and AdaBoost classifier (10.23%) after resampling. The AdaBoost obtained the highest value of kappa coefficient (0.9336) by using the training dataset resampled with ADASYN. The accuracy of classification on minority crops was also increased by resampling training datasets. Meanwhile, feature selection results showed that vegetation and texture indexes were more efficient than features of original reflection ratio to classification. Over-resampling methods had advantages in relieving the influence of imbalanced training samples to classifiers. Resampling process to training datasets has remarkable advantage in improving the classifier performance if the training datasets are critically imbalanced. The detailed accuracy assessment shows that over-resampling method is more excellent than under-resampling. The reason is that some significant samples are lost during under-resampling, but helpful and useful information is added after over-resampling. AdaBoost classifier performs better than decision tree in terms of solving imbalanced training datasets. Combination of proper resampling approaches and compatible classifier can significantly improve the accuracy of minority classes in the situation of imbalanced dataset classification.

mots-clés

crops recognition;imbalanced datasets;resampling;remote sensing;minority crops;GF-2

References

  1. 1.
    Arenas-Toledo J M and Epiphanio J C N. 2011. Harmonic amplitude-terms mask to highlight agriculture in the savanna domain below the Brazilian Amazonian frontier. International Journal of Remote Sensing, 32(18): 5021–5034
  2. 2.
    Cao Y, Miao Q G, Liu J C and Gao L. 2013. Advance and prospects of AdaBoost algorithm. Acta Automatica Sinica, 39(6): 745–758
  3. 3.
    Chawla N V, Bowyer K W, Hall L O and Kegelmeyer W P. 2002. SMOTE: synthetic minority over-sampling technique. Journal of Artificial Intelligence Research, 16(1): 321–357
  4. 4.
    Chen C F, Chen C R and Son N T. 2012. Investigating rice cropping practices and growing areas from MODIS data using empirical mode decomposition and support vector machines. Giscience and Remote Sensing, 49(1): 117–138
  5. 5.
    Cutler D R, Edwards T C Jr, Beard K H, Cutler A, Hess K T, Gibson J and Lawler J J. 2007. Random forests for classification in ecology. Ecology, 88(11): 2783–2792
  6. 6.
    Ding X. 2014. Study on Distribution of Crop’s Structure in Heilongjiang. Harbin: Northeast Agricultural University
  7. 7.
    Elhassan A T, Aljourf M, Al-Mohanna F and Shoukri M. 2017. Classification of imbalance data using tomek link (T-Link) combined with random under-sampling (RUS) as a data reduction method. Global Journal of Technology and Optimization(S1): 111
  8. 8.
    Foody G M and Mathur A. 2006. The use of small training sets containing mixed pixels for accurate hard image classification: training on mixed spectral responses for classification by a SVM. Remote Sensing of Environment, 103(2): 179–189
  9. 9.
    García V, Sánchez J S and Mollineda R A. 2011. Classification of high dimensional and imbalanced hyperspectral imagery data//Proceedings of the 5th Iberian Conference on Pattern Recognition and Image Analysis. Las Palmas de Gran Canaria, Spain: Springer [DOI: 10.1007/978-3-642-21257-4_80]
  10. 10.
    Haboudane D, Miller J R, Tremblay N, Zarco-Tejada P J and Dextraze L. 2002. Integrated narrow-band vegetation indices for prediction of crop chlorophyll content for application to precision agriculture. Remote Sensing of Environment, 81(2/3): 416–426
  11. 11.
    Han H, Wang W Y and Mao B H. 2005. Borderline-SMOTE: a new over-sampling method in imbalanced data sets learning//Huang D S, Zhang X P and Huang G B, eds. Advances in Intelligent Computing. Berlin Heidelberg: Springer [DOI: 10.1007/11538059_91]
  12. 12.
    Haralick R M, Shanmugam K and Dinstein I. 1973. Textural features for image classification. IEEE Transactions on Systems, Man, and Cybernetics, SMC-3(6): 610–621
  13. 13.
    Harris R. 2003. Remote sensing of agriculture change in Oman. International Journal of Remote Sensing, 24(23): 4835–4852
  14. 14.
    He H B, Bai Y, Garcia E A and Li S T. 2008. ADASYN: adaptive synthetic sampling approach for imbalanced learning//Proceedings of 2008 IEEE International Joint Conference on Neural Networks. Hong Kong, China: IEEE [DOI: 10.1109/IJCNN.2008.4633969]
  15. 15.
    Hixson M, Scholz D, Fuhs N and Akiyama T. 1980. Evaluation of several schemes for classification of remotely sensed data. Photogrammetric Engineering and Remote Sensing, 46(12): 1547–1553
  16. 16.
    Hu Q, Wu W B, Song Q, Yu Q Y, Yang P and Tang H J. 2015. Recent progresses in research of crop patterns mapping by using remote sensing. Scientia Agricultura Sinica, 48(10): 1900–1914
  17. 17.
    Huang D S. 2011. Research on Feature Selection and Semi-Supervised Classification. Wuhan: Huazhong University of Science and Technology
  18. 18.
    Jia K and Li Q Z. 2013. Review of features selection in crop classification using remote sensing data. Resources Science, 35(12): 2507–2516
  19. 19.
    Laurikkala J. 2001. Improving identification of difficult small classes by balancing class distribution//Quaglini S, Barahona P and Andreassen S, eds. Artificial Intelligence in Medicine. Berlin Heidelberg: Springer [DOI: 10.1007/3-540-48229-6_9]
  20. 20.
    Li Q Z and Wu B F. 2004. Accuracy assessment of planted area proportion using Landsat TM imagery. Journal of Remote Sensing, 8(6): 581–587
  21. 21.
    Liu J, Wang L M, Yang F G, Yang L B and Wang X L. 2015. Remote sensing estimation of crop planting area based on HJ time-series images. Transactions of the Chinese Society of Agricultural Engineering, 31(3): 199–206
  22. 22.
    Liu K B, Liu S B, Lu Z J, Song Q, Liu Y X, Zhang D M and Wu W B. 2014. Extraction on cropping structure based on high spatial resolution remote sensing data. Chinese Journal of Agricultural Resources and Regional Planning, 35(1): 21–26
  23. 23.
    Liu X N, Li X H, Sun D F, Li H, Zhang W W and Zhou L D. 2011. Landscape extraction and corridor site assessment of farmland in urban fringe using SPOT5 remote sensing image. Transactions of the CSAE, 27(4): 317–323
  24. 24.
    Mathur A and Foody G M. 2008. Crop classification by support vector machine with intelligently selected training data for an operational application. International Journal of Remote Sensing, 29(8): 2227–2240
  25. 25.
    Metternicht G. 2003. Vegetation indices derived from high-resolution airborne videography for precision crop management. International Journal of Remote Sensing, 24(14): 2855–2877
  26. 26.
    Murthy C S, Raju P V and Badrinath K V S. 2003. Classification of wheat crop with multi-temporal images: performance of maximum likelihood and artificial neural networks. International Journal of Remote Sensing, 24(23): 4871–4890
  27. 27.
    Punera K and Ghosh J. 2008. Consensus-based ensembles of soft clusterings. Applied Artificial Intelligence, 22(7/8): 780–810
  28. 28.
    Rätsch G, Onoda T and Müller K R. 2001. Soft margins for AdaBoost. Machine Learning, 42(3): 287–320
  29. 29.
    Rilwani M L and Ikhuoria I A. 2011. Prospects for geoinformatics-based precision farming in the Savanna River basin, Nigeria. International Journal of Remote Sensing, 32(12): 3539–3549
  30. 30.
    Sarkar A, Majumdar A, Chatterjee S, Chatterjee D, Ray S S and Kartikeyan B. 2008. Study of the potential of alternative crops by integration of multisource data using a neuro-fuzzy technique. International Journal of Remote Sensing, 29(19): 5479–5493
  31. 31.
    Shukla G, Garg R D, Srivastava H S and Garg P K. 2018. Performance analysis of different predictive models for crop classification across an aridic to ustic area of Indian states. Geocarto International, 33(3): 240–259
  32. 32.
    Sonobe R, Tani H, Wang X F, Kobayashi N and Shimamura H. 2014. Parameter tuning in the support vector machine and random forest and their performances in cross- and same-year crop classification using TerraSAR-X. International Journal of Remote Sensing, 32(23): 7898–7909
  33. 33.
    Tan C P, Ewe H T and Chuah H T. 2011. Agricultural crop-type classification of multi-polarization SAR images using a hybrid entropy decomposition and support vector machine technique. International Journal of Remote Sensing, 32(22): 7057–7071
  34. 34.
    Tumer K and Oza N C. 2003. Input decimated ensembles. Pattern Analysis and Applications, 6(1): 65–77
  35. 35.
    Waske B, Benediktsson J A and Sveinsson J R. 2009. Classifying remote sensing data with support vector machines and imbalanced training data//Proceedings of the 8th International Workshop on Multiple Classifier Systems. Reykjavik, Iceland: Springer [DOI: 10.1007/978-3-642-02326-2_38]
  36. 36.
    Wilson D L. 1972. Asymptotic properties of nearest neighbor rules using edited data. IEEE Transactions on Systems, Man, and Cybernetics, SMC-2(3): 408–421
  37. 37.
    Wu B F, Fan J L, Tian Y C, Li Q Z, Zhang L, Liu Z L, Zhang G L, He L H, Huang J L, Jiang X B, Yan C Z, Xu A and Zhang W Q. 2004a. A method for crop planting structure inventory and its application. Journal of Remote Sensing, 8(6): 618–627
  38. 38.
    Wu B F, Xu W B, Sun M, Li Q Z and Huang H P. 2004b. QuickBird imagery for crop pattern mapping. Journal of Remote Sensing, 8(6): 688–695
  39. 39.
    Wu J P and Yang X W. 1996. Purification of training samples in supervised classification of remote sensing data. Remote Sensing for Land and Resources, 8(1): 36–41
  40. 40.
    Zhao Y S. 2003. The Principle and Method of Analysis of Remote Sensing Application. Beijing: Science Press
  41. 41.
    Zhu X F, Pan Y Z, Zhang J S, Wang S, Gu X H and Xu C. 2007. The effects of training samples on the wheat planting area measure accuracy in TM scale (Ⅰ): the accuracy response of different classifiers to training samples. Journal of Remote Sensing, 11(6): 826–837

Lire l'article complet

The above content is generated by Large Model Translation. The translated content is for reference only. We do not assume any commercial or legal responsibilty for any consequences arising from the use of our website