Classification des séries temporelles de données satellitaires à l'aide du mécanisme d'attention auto-temporel

  • role: First author第一作者
  • Affiliation:

    Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100094, China

    University of Chinese Academy of Sciences, School of Electronic, Electrical and Communication Engineering, Beijing 100049, China

  • Email:zhangweixiong@aircas.ac.cn
  • Introduction:张伟雄,研究方向为遥感图像处理。E-mail:zhangweixiong@aircas.ac.cn
ZHANG Weixiong12,  
  • Affiliation:

    Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100094, China

TANG Ping1,  
  • role: Corresponding author通信作者
  • Affiliation:

    Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100094, China

  • Email:zhangzheng@aircas.ac.cn
  • Introduction:张正,研究方向为遥感图像处理,遥感时间序列分析。E-mail:zhangzheng@aircas.ac.cn
ZHANG Zheng1*

résumé

La série temporelle d'images satellitaires fournit une base de données importante pour l'étude de la classification de la couverture terrestre. L'extraction des caractéristiques de classification temporelle à l'aide de l'apprentissage en profondeur a toujours été un sujet de recherche brûlant, tandis que les modèles d'apprentissage profond basés sur les réseaux récurrents et convolutionnels ont souvent du mal à obtenir des résultats de classification de grande précision sur de petits échantillons d'entraînement. Pour résoudre ce problème, cet article introduit les dernières méthodes de traitement du langage naturel dans le domaine de l'attention automatique pour la classification des séries temporelles multispectrales satellitaires. En améliorant l'encodeur Transformer : (1) ajout d'une couche d'élévation des caractéristiques avant l'attention multi-têtes, pour améliorer l'information spectrale; (2) utilisation de l'étirement après la réduction de dimension au lieu du maximum global poolin

mots-clés

Mécanisme d'attention ; Apprentissage profond ; Séries temporelles de données satellitaires ; Classification de la couverture terrestre ; Échantillons déséquilibrés

References

  1. 1.
    Garnot V S F and Landrieu L. 2020. Lightweight temporal self-attention for classifying satellite images time series//5th ECML PKDD Workshop on Advanced Analytics and Learning on Temporal Data. Ghent: Springer: 171-181
  2. 2.
    Garnot V S F, Landrieu L, Giordano S and Chehata N. 2020. Satellite image time series classification with pixel-set encoders and temporal self-attention//2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Seattle: IEEE: 12322-12331
  3. 3.
    Hochreiter S and Schmidhuber J. 1997. Long short-term memory. Neural Computation, 9(8): 1735-1780
  4. 4.
    Ienco D, Gaetano R, Dupaquier C and Maurel P. 2017. Land cover classification via multitemporal spatial data by deep recurrent neural networks. IEEE Geoscience and Remote Sensing Letters, 14(10): 1685-1689
  5. 5.
    Kingma D P and Ba J. 2015. Adam: a method for stochastic optimization//3rd International Conference on Learning Representations. San Diego: ICLR
  6. 6.
    Lin T Y, Goyal P, Girshick R, He K M and Dollar P. 2017. Focal loss for dense object detection//2017 IEEE International Conference on Computer Vision. Venice: IEEE: 2999-3007
  7. 7.
    Maus V, Câmara G, Cartaxo R, Sanchez A, Ramos F M and de Queiroz G R. 2016. A time-weighted dynamic time warping method for land-use and land-cover mapping. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 9(8): 3729-3739
  8. 8.
    Mikolov T, Sutskever I, Chen K, Corrado G and Dean J. 2013. Distributed representations of words and phrases and their compositionality//Proceedings of the 26th International Conference on Neural Information Processing Systems. Lake Tahoe: Curran Associates Inc.: 3111-3119
  9. 9.
    Pelletier C, Webb G and Petitjean F. 2019. Temporal convolutional neural network for the classification of satellite image time series. Remote Sensing, 11(5): 523
  10. 10.
    Petitjean F, Inglada J and Gancarski P. 2012. Satellite image time series analysis under time warping. IEEE Transactions on Geoscience and Remote Sensing, 50(8): 3081-3095
  11. 11.
    Rußwurm M and Körner M. 2017. Temporal vegetation modelling using long short-term memory networks for crop identification from medium-resolution multi-spectral satellite images//2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW). Honolulu: IEEE: 1496-1504
  12. 12.
    Rußwurm M and Körner M. 2018. Multi-temporal land cover classification with sequential recurrent encoders. ISPRS International Journal of Geo-Information, 7(4): 129
  13. 13.
    Rußwurm M., & Körner M. 2020. Self-attention for raw optical satellite time series classification. ISPRS journal of photogrammetry and remote sensing, 169, 421-435
  14. 14.
    Sutskever I, Vinyals O and Le Q V. 2014. Sequence to sequence learning with neural networks//Proceedings of the 27th International Conference on Neural Information Processing Systems. Montreal: MIT Press: 3104-3112
  15. 15.
    Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez A N, Kaiser Ł and Polosukhin I. 2017. Attention is all you need//Proceedings of the 31st International Conference on Neural Information Processing Systems. Long Beach: Curran Associates Inc.: 6000-6010
  16. 16.
    Zhang Z, Tang P and Duan R B. 2015. Dynamic time warping under pointwise shape context. Information Sciences, 315: 88-101
  17. 17.
    Zhang Z, Tang P, Huo L Z and Zhou Z G. 2014. MODIS NDVI time series clustering under dynamic time warping. International Journal of Wavelets, Multiresolution and Information Processing, 12(5): 1461011
  18. 18.
    Zhang Z, Tavenard R, Bailly A, Tang X T, Tang P and Corpetti T. 2017. Dynamic time warping under limited warping path length. Information Sciences, 393: 91-107
  19. 19.
    Zhong L H, Hu L N and Zhou H. 2019. Deep learning based multi-temporal crop classification. Remote Sensing of Environment, 221: 430-443

Lire l'article complet

The above content is generated by Large Model Translation. The translated content is for reference only. We do not assume any commercial or legal responsibilty for any consequences arising from the use of our website