Précédent|Prochain

Wetland classification based on Sentinel-2 and 3D multisource domain self-attention model

  • role： First author第一作者
  • Affiliation：

    School of Geography and Planning, Sun Yat-sen University, Guangzhou, 510275, China

  • Email：louanj@mail2.sysu.edu.cn
  • Introduction：楼桉君，研究方向为湿地遥感。E-mail： louanj@mail2.sysu.edu.cn
LOU Anjun1,  
  • role： Corresponding author通信作者
  • Affiliation：

    School of Geography and Planning, Sun Yat-sen University, Guangzhou, 510275, China

    Guangdong Provincial Laboratory of Marine Science and Engineering (Zhuhai), Zhuhai 519082, China

  • Email：Hezh8@mail.sysu.edu.cn
  • Introduction：贺智，研究方向为高分/高光谱遥感、模式识别和深度学习等。E-mail： Hezh8@mail.sysu.edu.cn
HE Zhi12*,  
  • Affiliation：

    School of Geography and Planning, Sun Yat-sen University, Guangzhou, 510275, China

XIAO Man1,  
  • Affiliation：

    School of Geography and Planning, Sun Yat-sen University, Guangzhou, 510275, China

LI Xinyuan1

résumé

Accurate wetland classification methods can quickly grasp the spatial-temporal variation characteristics of wetlands and play an important role in wetland research. Considering the limitation of the existing wetland classification method based on few-shot learning to the use of target or single-source domain dataset, this paper proposes a 3D multisource domain self-attention few-shot learning (3D-MDAFSL) model. First, combining the advantages of convolution and attention mechanism, a 3D feature extractor based on self-attention mechanism and deep residual convolution is designed. Then, the conditional adversarial domain adaptation strategy is used to achieve multisource domain distribution alignment, and few-shot learning is performed separately in each domain. Finally, the features extracted by the trained model are imputed to the K-nearest neighbor classifier to obtain classification results. Results show that compared with the framework without feature extraction, the 3D feature extractor improves the overall accuracy by approximately 6.79%. When using multisource domain datasets, the overall accuracy of the 3D-MDAFSL model for the Sentinel-2 wetland dataset in Zhongshan City can reach 93.52%, which is a significant improvement compared with the existing algorithms. The 3D-MDAFSL model proposed in this paper has good application value in the high-precision extraction and classification of wetland features.

mots-clés

remote sensing;Few-shot;wetland classification;Multi-source domain adaption;Self-attention

References

  1. 1.
    Bahdanau D, Cho K and Bengio Y. 2014. Neural machine translation by jointly learning to align and translate//Proceedings of the 3rd International Conference on Learning Representations. San Diego: [s.l.]
  2. 2.
    Cao J Z, Li Y W, Zhang K and Van Gool L. 2021. Video super-resolution transformer. arXiv:2106.06847
  3. 3.
    Cao Z Y, Li X R, Jiang J F and Zhao L Y. 2020. 3D convolutional siamese network for few-shot hyperspectral classification. Journal of Applied Remote Sensing, 14(4): 048504
  4. 4.
    Chen N X, Watanabe S, Villalba J, Żelasko P and Dehak N. 2021. Non-autoregressive transformer for speech recognition. IEEE Signal Processing Letters, 28: 121-125
  5. 5.
    Cho K, Van Merriënboer B, Gulcehre C, Bahdanau D, Bougares F, Schwenk H and Bengio Y. 2014. Learning phrase representations using RNN encoder-decoder for statistical machine translation//Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing. Doha: ACL
  6. 6.
    Dai Z H, Liu H X, Le Q V and Tan M X. 2021. CoAtNet: marrying convolution and attention for all data sizes//Proceedings of the 35th Conference on Neural Information Processing Systems. [s.l.]: [s.n.]: 3965-3977
  7. 7.
    Deng C, Liu X L, Li C and Tao D C. 2018. Active multi-kernel domain adaptation for hyperspectral image classification. Pattern Recognition, 77: 306-315
  8. 8.
    Deng J, Dong W, Socher R, Li L J, Li K and Li F F. 2009. ImageNet: a large-scale hierarchical image database//Proceedings of 2009 IEEE Conference on Computer Vision and Pattern Recognition. Miami: IEEE
  9. 9.
    Dosovitskiy A, Beyer L, Kolesnikov A, Weissenborn D, Zhai X H, Unterthiner T, Dehghani M, Minderer M, Heigold G and Gelly S, Uszkoreit J and Houlsby N. 2021. An image is worth 16x16 words: transformers for image recognition at scale//Proceedings of the 9th International Conference on Learning Representations. [s.l.]: OpenReview.net
  10. 10.
    Fu B L, Liu M, He H C, Lan F W, He X, Liu L L, Huang L K, Fan D L, Zhao M and Jia Z L. 2021. Comparison of optimized object-based rf-dt algorithm and segnet algorithm for classifying karst wetland vegetation communities using ultra-high spatial resolution uav data. International Journal of Applied Earth Observation and Geoinformation, 104: 102553
  11. 11.
    Gao K L, Liu B, Yu X C, Qin J C, Zhang P Q and Tan X. 2020. Deep relation network for hyperspectral image few-shot classification. Remote Sensing, 12(6): 923
  12. 12.
    Gong J Y and Ji S P. 2017. From photogrammetry to computer vision. Geomatics and Information Science of Wuhan University, 42(11): 1518-1522, 1615
  13. 13.
    Gong R, Dai D X, Chen Y H, Li W and Van Gool L. 2021. mDALU: multi-source domain adaptation and label unification with partial datasets//Proceedings of 2021 IEEE/CVF International Conference on Computer Vision. Montreal: IEEE
  14. 14.
    Gu Y X, Lan X, Fu B Y and Qin X L. 2023. Object detection algorithm for remote sensing images based on geometric adaptation and global perception. Journal of Computer Applications, 43(3): 916-922
  15. 15.
    Guo H J, Cai Y P, Yang Z F, Zhu Z C and Ouyang Y R. 2021. Dynamic simulation of coastal wetlands for Guangdong-Hong Kong-Macao Greater Bay area based on multi-temporal Landsat images and FLUS model. Ecological Indicators, 125: 107559
  16. 16.
    Gxokwe S, Dube T and Mazvimavi D. 2022. Leveraging Google Earth Engine platform to characterize and map small seasonal wetlands in the semi-arid environments of South Africa. Science of the Total Environment, 803: 150139
  17. 17.
    Hu Q, Woldt W, Neale C, Zhou Y Z, Drahota J, Varner D, Bishop A, LaGrange T, Zhang L G and Tang Z H. 2021. Utilizing unsupervised learning, multi-view imaging, and CNN-based attention facilitates cost-effective wetland mapping. Remote Sensing of Environment, 267: 112757
  18. 18.
    Jiao L C, Liang M M, Chen H, Yang S Y, Liu H Y and Cao X H. 2017. Deep fully convolutional network-based spatial distribution prediction for hyperspectral image classification. IEEE Transactions on Geoscience and Remote Sensing, 55(10): 5585-5599
  19. 19.
    Li Z K, Liu M, Chen Y S, Xu Y M, Li W and Du Q. 2022. Deep cross-domain few-shot learning for hyperspectral image classification. IEEE Transactions on Geoscience and Remote Sensing, 60: 5501618
  20. 20.
    Liu B, Yu X C, Yu A Z, Zhang P Q, Wan G and Wang R R. 2019. Deep few-shot learning for hyperspectral image classification. IEEE Transactions on Geoscience and Remote Sensing, 57(4): 2290-2304
  21. 21.
    Liu W. 2020. Domain Adaptation for the High Resolution Remote Sensing Image Classification. Harbin: Harbin Institute of Technology
  22. 22.
    Mei S H, Ji J Y, Hou J H, Li X and Du Q. 2017. Learning sensor-specific spatial-spectral features of hyperspectral images via convolutional neural networks. IEEE Transactions on Geoscience and Remote Sensing, 55(8): 4520-4533
  23. 23.
    Meng X R. 2019. Study on Remote Sensing Finer Classification of Freshwater Wetland Based on Deep Learning. Harbin: Harbin Normal University
  24. 24.
    Mo L J, Cao Y, Hu Y M, Liu M and Xiao D. 2012. Object-oriented classification for satellite remote sensing of wetlands: a case study in southern Hangzhou bay area. Wetland Science, 10(2): 206-213
  25. 25.
    Ning X G, Chang W T, Wang H, Zhang H C and Zhu Q D. 2022. Extraction of marsh wetland in Heilongjiang Basin based on GEE and multi-source remote sensing data. National Remote Sensing Bulletin, 26(2): 386-396
  26. 26.
    Othman E, Bazi Y, Melgani F, Alhichri H, Alajlan N and Zuair M. 2017. Domain adaptation network for cross-scene classification. IEEE Transactions on Geoscience and Remote Sensing, 55(8): 4441-4456
  27. 27.
    Rao M B, Tang P and Zhang Z. 2019. Spatial–spectral relation network for hyperspectral image classification with limited training samples. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 12(12): 5086-5100
  28. 28.
    Shen J, Qu Y R, Zhang W N and Yu Y. 2018. Wasserstein distance guided representation learning for domain adaptation//Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence and Thirtieth Innovative Applications of Artificial Intelligence Conference and Eighth AAAI Symposium on Educational Advances in Artificial Intelligence. New Orleans: AAAI Press
  29. 29.
    Simonyan K and Zisserman A. 2015. Very deep convolutional networks for large-scale image recognition//Proceedings of the 3rd International Conference on Learning Representations. San Diego: [s.n.]
  30. 30.
    Ståhl N and Weimann L. 2022. Identifying wetland areas in historical maps using deep convolutional neural networks. Ecological Informatics, 68: 101557
  31. 31.
    Sutskever I, Vinyals O and Le Q V. 2014. Sequence to sequence learning with neural networks//Proceedings of the 27th International Conference on Neural Information Processing Systems. Montreal: MIT Press
  32. 32.
    Tuia D, Persello C and Bruzzone L. 2016. Domain adaptation for the classification of remote sensing data: An overview of recent advances. IEEE Geoscience and Remote Sensing Magazine, 4(2): 41-57
  33. 33.
    Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez A N, Kaiser Ł and Polosukhin I. 2017. Attention is all you need//Proceedings of the 31st International Conference on Neural Information Processing Systems. Long Beach: Curran Associates Inc
  34. 34.
    Wang G L, Fan B, Xiang S M and Pan C H. 2017. Aggregating rich hierarchical features for scene classification in remote sensing imagery. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 10(9): 4104-4115
  35. 35.
    Wang Z M, Du B, Shi Q and Tu W P. 2019. Domain adaptation with discriminative distribution and manifold embedding for hyperspectral image classification. IEEE Geoscience and Remote Sensing Letters, 16(7): 1155-1159
  36. 36.
    Yang H L and Crawford M M. 2016. Domain adaptation with preservation of manifold geometry for hyperspectral image classification. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 9(2): 543-555
  37. 37.
    Yang J X, Zhao Y Q and Chan J C W. 2017. Learning and transferring deep joint spectral–spatial features for hyperspectral classification. IEEE Transactions on Geoscience Remote Sensing, 55(8): 4729-4742
  38. 38.
    Yang L X, Zhang R Y, Li L D and Xie X H. 2021. SimAM: a simple, parameter-free attention module for convolutional neural networks//Proceedings of the 38th International Conference on Machine Learning. [s.l.]: PMLR
  39. 39.
    Yu S Q, Jia S, and Xu C Y. 2017. Convolutional neural networks for hyperspectral image classification. Neurocomputing, 219: 88-98
  40. 40.
    Zhang K Y. 2019. Remote Sensing Mapping and Evolution Analysis of Coastal Beach Based on Time Series Image Analysis of Google Earth Engine Platform. Shenzhen: Shenzhen University
  41. 41.
    Zhao S C, Wang G Z, Zhang S H, Gu Y, Li Y X, Song Z C, Xu P F, Hu R B, Chai H and Keutzer K. 2020. Multi-source distilling domain adaptation//Proceedings of the Thirty-Fourth AAAI Conference on Artificial Intelligencem, AAAI 2020, The Thirty-Second Innovative Applications of Artificial Intelligence Conference, IAAI 2020, The Tenth AAAI Symposium on Educational Advances in Artificial Intelligence. New York: AAAI Press

Lire l'article complet

The above content is generated by Large Model Translation. The translated content is for reference only. We do not assume any commercial or legal responsibilty for any consequences arising from the use of our website