سابِق|تال

Multi-graph convolutional network for a remote sensing image few shot classification

  • role： First author第一作者
  • Affiliation：

    School of Computer Science, Shaanxi Normal University, Xi'an 710119, China

  • Email：2286336238@qq.com
  • Introduction：陈杰虎，研究方向为图神经网络、小样本学习。E-mail： 2286336238@qq.com
CHEN Jiehu,  
  • role： Corresponding author通信作者
  • Affiliation：

    School of Computer Science, Shaanxi Normal University, Xi'an 710119, China

  • Email：wangxili@snnu.edu.cn
  • Introduction：汪西莉，研究方向为智能信号处理、模式识别、图像处理。E-mail： wangxili@snnu.edu.cn
WANG Xili*

ملخص

Few shot classification is a hot topic in the field of deep learning, which aims at identifying novel concepts with little supervisory information. In the remote sensing scene few shot classification, existing methods are often unable to achieve satisfactory accuracy because the relationships among samples are ignored. To improve the RS few shot classification accuracy, the multi-graph convolutional network (Multi-GCN) is proposed in this paper. In the proposed method, a graph convolutional network is introduced into the metric network to smooth the samples’ features, which can model relationships among samples, make images from the same class get more similar feature representation and improve the classification accuracy. The proposed Multi-GCN is mainly composed of three parts: (1) Feature extraction network, which is composed of 4-layer convolutional neural networks and is used to extract images’ features; (2) Graph convolutional network, which is used to model the relationships among samples in the feature space, and update the node features by multi-graph convolution; (3) Metric prediction part, which is used to calculate the prototype of each class, and predict labels of the unlabeled samples according to the distance between samples and prototypes. Based on spectral domain analysis, the proposed multi-graph convolution can effectively suppress the high-frequency components of the graph signals and significantly enhance the clustering coefficients of features from the same class. In addition, the fine-tuning method is introduced in the training process, and labeled samples in the new class are used to train the last layer of the graph convolutional network for a small number of steps, which can further improve the classification accuracy and enhance the transfer ability of the model. To validate the effectiveness of the proposed method, in the experiments, Multi-GCN is compared with ProtoNet, GNN-FSL, and two single graph based methods ProtoGCN and ProtoIGCN on two different tasks, i.e. the same dataset few shot classification task and cross datasets few shot classification task. From the experimental results, we can obtain that in the same dataset few shot classification task, the proposed method is significantly superior to ProtoNet. When the number of labeled samples of each class is 1, the accuracy of the proposed method is higher than ProtoNet by more than 5%; Compared with GNN-FSL, the accuracy of the proposed method is about 10% higher on average. In the cross datasets few shot classification task, the classification accuracy of the proposed method is 10%—15% higher than that of GNN-FSL; And compared with ProtoNet, it is about 10% higher in the case of 1-shot and about 2%—5% higher in the case of 5-shot. In most cases, Multi-GCN is also better than single graph methods, such as ProtoGCN and ProtoIGCN. The classification accuracy can be further improved by using fine-tuning training methods. From the above experimental results, we can conclude that the proposed method can achieve a higher classification accuracy compared with ProtoNet, GNN-FSL, and the methods based on a single graph convolutional network. The conclusions of multi-graph convolutional operation and spectrum analysis in this work can also be extended to other graph-based semi-supervised learning.

مفهوم

few shot learning;remote sensing scene classification;metric learning;multi-graph convolution;graph spectral analysis

References

  1. 1.
    Chen W Y, Liu Y C, Kira Z, Wang Y C and Huang J B. 2019. A closer look at few-shot classification//Proceedings of the 7th International Conference on Learning Representations. New Orleans, United State: ICLR: 1-17
  2. 2.
    Cheng G, Xie X X, Han J W, Guo L and Xia G S. 2020. Remote sensing image scene classification meets deep learning: challenges, methods, benchmarks, and opportunities. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 13: 3735-3756
  3. 3.
    Deng P F, Xu K J and Huang H. 2021. CNN-GCN-based dual-stream network for scene classification of remote sensing images. Journal of Remote Sensing, 25(11):2270-2282
  4. 4.
    Garcia V and Bruna J. 2018. Few-shot learning with graph neural networks//Proceedings of the 6th International Conference on Learning Representations. Vancouver, Canada: ICLR: 1-13
  5. 5.
    Hoang N T and Maehara T. 2019. Revisiting graph neural networks: all we have is low-pass filters. arXiv: 1905.09550
  6. 6.
    Hong D F, Gao L R, Yao J, Zhang B, Plaza A and Chanussot J. 2021. Graph convolutional networks for hyperspectral image classification. IEEE Transactions on Geoscience and Remote Sensing, 59(7): 5966-5978
  7. 7.
    Kipf T N and Welling M. 2017. Semi-supervised classification with graph convolutional networks//Proceedings of the 5th International Conference on Learning Representations. Toulon, France: ICLR: 1-14
  8. 8.
    Koch G, Zemel R and Salakhutdinov R. 2015. Siamese neural networks for one-shot image recognition//Proceedings of the 32nd International Conference on Machine Learning. Lille, France: ICML: 1-9
  9. 9.
    Li Q M, Wu X M, Liu H, Zhang X T and Guan Z C. 2019a. Label efficient semi-supervised learning via graph filtering//Proceedings of the 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Long Beach, CA: IEEE: 9574-9583
  10. 10.
    Li W B, Wang L, Xu J L, Huo J, Gao Y and Luo J B. 2019b. Revisiting local descriptor based image-to-class measure for few-shot learning//Proceedings of the 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Long Beach, CA: IEEE: 7253-7260
  11. 11.
    Liu K, Zhou Z, Li S Y, Liu Y F, Wan X, Liu Z W, Tan H and Zhang W F. 2020. Scene classification dataset using the Tiangong-1 hyperspectral remote sensing imagery and its applications. Journal of Remote Sensing, 24(9): 1077-1087
  12. 12.
    Liu X R, Jin W, Ma Y, Li Y X, Wang Y Q, Yan M and Tang J L. 2021. Elastic graph neural networks//Proceedings of the 38th International Conference on Machine Learning. Vienna, Austria: ICML: 6837-6849
  13. 13.
    Lu J, Gong P H, Ye J P and Zhang C S. 2020. Learning from very few samples: a survey. arXiv: 2009.02653
  14. 14.
    Mou L C, Lu X Q, Li X L and Zhu X X. 2020. Nonlocal graph convolutional networks for hyperspectral image classification. IEEE Transactions on Geoscience and Remote Sensing, 58(12): 8246-8257
  15. 15.
    Ouyang S B, Chen W T, Li X J, Dong Y S and Wang L Z. 2022. Geomorphological scene classification dataset of high-resolution remote sensing imagery in vegetation-covered areas. Journal of Remote Sensing, 26(4):606-619
  16. 16.
    Scott G J, Hagan K C, Marcum R A, Hurt J A, Anderson D T and Davis C H. 2018. Enhanced fusion of deep neural networks for classification of benchmark high-resolution image data sets. IEEE Geoscience and Remote Sensing Letters, 15(9): 1451-1455
  17. 17.
    Shuman D I, Narang S K, Frossard P, Ortega A and Vandergheynst P. 2013. The emerging field of signal processing on graphs: extending high-dimensional data analysis to networks and other irregular domains. IEEE Signal Processing Magazine, 30(3): 83-98
  18. 18.
    Snell J, Swersky K and Zemel R. 2017. Prototypical networks for few-shot learning//Proceedings of the 31st International Conference on Neural Information Processing Systems. Long Beach, California: Curran Associates Inc.: 4080-4090.
  19. 19.
    Sung F, Yang Y X, Zhang L, Xiang T, Torr P H S and Hospedales T M. 2018. Learning to compare: relation network for few-shot learning//Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Salt Lake City, UT: IEEE: 1199-1208
  20. 20.
    Vinyals O, Blundell C, Lillicrap T, Kavukcuoglu K and Wierstra D. 2016. Matching networks for one shot learning//Proceedings of the 30th International Conference on Neural Information Processing Systems. Barcelona: Curran Associates Inc.: 3637-3645
  21. 21.
    Wan S, Gong C, Zhong P, Pan S R, Li G Y and Yang J. 2021. Hyperspectral image classification with context-aware dynamic graph convolutional network. IEEE Transactions on Geoscience and Remote Sensing, 59(1): 597-612
  22. 22.
    Wang Q, Liu S T, Chanussot J and Li X L. 2019. Scene classification with recurrent attention of VHR remote sensing images. IEEE Transactions on Geoscience and Remote Sensing, 57(2): 1155-1167
  23. 23.
    Wu F, Zhang T Y, de Souza A H, Fifty C, Yu T and Weinberger K Q. 2019. Simplifying graph convolutional networks//Proceedings of the 36th International Conference on Machine Learning. Long Beach, United States: ICML: 6861-6871
  24. 24.
    Yang S Q, Jin Z, Yu Y L and Lin H. 2019. Analysis of the spatial-temporal characteristics of LUCC from 1975 to 2015 in the Dongzhi loess tableland. Quaternary Sciences, 39(6): 1433-1442
  25. 25.
    Yu D H, Zhang B M, Zhao C, Guo H T and Lu J. 2020. Scene classification of remote sensing image using ensemble convolutional neural network. Journal of Remote Sensing, 24(6): 717-727
  26. 26.
    Zhou W X, Newsam S, Li C M and Shao Z F. 2018. PatternNet: a benchmark dataset for performance evaluation of remote sensing image retrieval. ISPRS Journal of Photogrammetry and Remote Sensing, 145: 197-209

قراءة النص الكامل

The above content is generated by Large Model Translation. The translated content is for reference only. We do not assume any commercial or legal responsibilty for any consequences arising from the use of our website