Transfer learning method for landslide extraction from GF-1 images after the Wenchuan earthquake

LI Zhen; LI Shanshan; GE Xiaoqing

doi:10.11834/jrs.20211020

GeologyandDisasters | Views : 0 下载量: 374 CSCD: 0 更多指标

R-PDF
PDF
Export
Share
Collection
Album

Transfer learning method for landslide extraction from GF-1 images after the Wenchuan earthquake
Vol. 27, Issue 8, Pages: 1866-1875(2023)
Published： 07 August 2023 ，
DOI： 10.11834/jrs.20211020

扫描看全文

李震，李山山，葛小青.2023.迁移学习方法提取高分一号影像汶川地震震后滑坡.遥感学报，27（8）： 1866-1875

Li Z，Li S S and Ge X Q. 2023. Transfer learning method for landslide extraction from GF-1 images after the Wenchuan earthquake. National Remote Sensing Bulletin， 27（8）：1866-1875
李震，李山山，葛小青.2023.迁移学习方法提取高分一号影像汶川地震震后滑坡.遥感学报，27（8）： 1866-1875 DOI： 10.11834/jrs.20211020.

Li Z，Li S S and Ge X Q. 2023. Transfer learning method for landslide extraction from GF-1 images after the Wenchuan earthquake. National Remote Sensing Bulletin， 27（8）：1866-1875 DOI： 10.11834/jrs.20211020.

摘要

2008年汶川8.0级地震触发了大量的崩塌滑坡地质灾害，导致强震区震后地质灾害频发，因其对生命和财产的巨大威胁而广泛关注。利用遥感等技术快速提取滑坡信息，对于减少灾害造成的损失具有重要的现实意义。本文提出一种迁移学习方法，从自然场景数据集中学习特征，迁移到滑坡提取中。该方法首先在ImageNet上预训练ResNet网络，然后输入滑坡区影像样本，将预训练网络及参数迁移至LinkNet上，最终实现滑坡提取。通过对2013年—2015年3景影像的汶川地震震后滑坡提取实验进行分析及验证，结果显示相较于传统支持向量机和其他深度学习方法，本文提出的迁移学习方法有较优的提取精度，有利于后续研判及决策。

Abstract

Landslides are natural disasters that are driven by various factors and often leave catastrophic damages and casualties. A huge earthquake can trigger plenty of landslides. Therefore

landslide extraction is critical to provide timely information for post-disaster decision making. Remote sensing is a convenient tool for landslide information acquisition. However

landslide features are so intricate that landslide extraction mainly relies on a visual interpretation of aerial photographs or high-resolution remote sensing images

which requires vast manpower. Several landslide extraction methods are available today

including pixel-based methods

which have relatively low accuracy

and object-oriented methods

whose parameters need to be decided subjectively. With the continuous development of deep learning in image semantic segmentation

a precise and automatic remote sensing image binary classification becomes possible. Many researchers have investigated the use of deep learning for landslide extraction in different areas. However

a relatively small amount of landslide data can easily lead to model overfitting. Transfer learning

where knowledge is transferred from the source domain to the target domain

can alleviate this problem by using knowledge in the source domain to improve performance in the target task. A transfer learning deep network is then designed to improve the accuracy of landslide extraction.

First

three GF-1 images taken from 2013 to 2015 in the research area were processed successively by geometric correction

registration

and image fusion to obtain 4 bands of images (red

green

blue

and near-infrared) with a resolution of 2 m. Second

a proper network was designed. The encoder of ResNet that was trained on ImageNet was chosen as the encoder

and the decoder of LinkNet

whose residual structure and bypass links can improve performance

was selected as the decoder. The bypass links in the decoder can also address the spatial information loss in max-pooling in the encoder

and the residual structure allows the network to learn complex features. After pre-training the ResNet network on ImageNet

we adjusted the number of input channels of the first convolution layer to 4

drop the last fully connected layer

and then form our network with the decoder. We eventually inputted remote sensing landslide images to finetune our model.

When testing different network depths

the network does not always perform better as the depth increases. We chose ResNet50 as our encoder given its peak performance. Afterward

we compared our method with SVM. Without a pre-training encoder

our network improves U-Net and a mainstream transfer learning method

AlbuNet

thereby suggesting that deep learning methods outperform SVM

whereas transfer learning methods outperform deep learning methods that are trained on landslide images. The proposed method outperforms SVM in terms of precision

recall

and F1 measure by 17.16%

18.58%

and 17.4%

respectively

outperforms the improved U-Net by 2.98%

6.35%

and 4.61%

and outperforms AlbuNet by 0.9%

1.98%

and 1.48%.

The ResNet50 encoder combined with the LinkNet decoder should be selected to form a landslide extraction network with a higher accuracy compared with the transfer learning network AlbuNet and other ResNet encoders of different depths. Transferring knowledge learned from ImageNet can also improve the performance of the landslide extraction deep learning network. The proposed method can be used conveniently for follow-up landslide risk assessment

disaster investigation

disaster warning

and decision making.

关键词

遥感滑坡提取迁移学习ImageNet高分一号

Keywords

remote sensinglandslide extractiontransfer learningImageNetGF-1

references

An L Q, Zhang J F and Zhao F J. 2011. Extracting secondary disaster of Wenchuan earthquake: application of object-oriented image-classifying technology. Journal of Natural Disasters, 20(2): 160-168

安立强, 张景发, 赵福军. 2011. 汶川地震次生灾害提取——面向对象影像分类技术的应用. 自然灾害学报, 20(2): 160-168 [DOI: 10.13577/j.jnd.2011.0225http://dx.doi.org/10.13577/j.jnd.2011.0225]

Dai W Y, Xue G R, Yang Q and Yu Y. 2007. Co-clustering based classification for out-of-domain documents//Proceedings of the 13th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. San Jose: ACM: 210-219 [DOI: 10.1145/1281192.1281218http://dx.doi.org/10.1145/1281192.1281218]

Fan J R, Zhang X Y, Su F H, Ge Y G, Tarolli P, Yang Z Y, Zeng C and Zeng Z. 2017. Geometrical feature analysis and disaster assessment of the Xinmo landslide based on remote sensing data. Journal of Mountain Science, 14(9): 1677-1688 [DOI: 10.1007/s11629-017-4633-3http://dx.doi.org/10.1007/s11629-017-4633-3]

He K M, Zhang X Y, Ren S Q and Sun J. 2016. Deep residual learning for image recognition//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Las Vegas: IEEE: 770-778 [DOI: 10.1109/CVPR.2016.90http://dx.doi.org/10.1109/CVPR.2016.90]

Huang T, Bai X F, Zhuang Q F and Xu J H. 2018. Research on landslides extraction based on the Wenchuan earthquake in GF-1 remote sensing image. Bulletin of Surveying and Mapping, 2: 67-71, 82

黄汀, 白仙富, 庄齐枫, 徐敬海. 2018. 高分一号汶川极震区滑坡提取研究. 测绘通报, (2): 67-71, 82 [DOI: 10.13474/j.cnki.11-2246.2018.0046http://dx.doi.org/10.13474/j.cnki.11-2246.2018.0046]

LeCun Y, Bengio Y and Hinton G. 2015. Deep learning. Nature, 521(7553): 436-444 [DOI: 10.1038/nature14539http://dx.doi.org/10.1038/nature14539]

Li Q, Zhang J F, Luo Y and Jiao Q S. 2019. Recognition of earthquake-induced landslide and spatial distribution patterns triggered by the Jiuzhaigou earthquake in August 8, 2017. Journal of Remote Sensing, 23(4): 785-795

李强, 张景发, 罗毅, 焦其松. 2019. 2017年“8. 8”九寨沟地震滑坡自动识别与空间分布特征. 遥感学报, 23(4): 785-795 [DOI: 10.11834/jrs.20197345http://dx.doi.org/10.11834/jrs.20197345]

Li S, Deng B K, Xu H Q and Wang Z F. 2015. Fast interpretation methods of landslides triggered by earthquake using remote sensing imagery. Remote Sensing Information, 30(4): 25-28

李松, 邓宝昆, 徐红勤, 王治福. 2015. 地震型滑坡灾害遥感快速识别方法研究. 遥感信息, 30(4): 25-28 [DOI: 10.3969/j.issn.1000-3177.2015.04.005http://dx.doi.org/10.3969/j.issn.1000-3177.2015.04.005]

Li W L, Wu J and Lü B X. 2011. Research on landslide triggered by earthquake: review and prospect. Journal of Catastrophology, 26(3): 103-108

李为乐, 伍霁, 吕宝雄. 2011. 地震滑坡研究回顾与展望. 灾害学, 26(3): 103-108 [DOI: 10.3969/j.issn.1000-811X.2011.03.021http://dx.doi.org/10.3969/j.issn.1000-811X.2011.03.021]

Liu P, Wei Y M, Wang Q J, Chen Y and Xie J J. 2020. Research on post-earthquake landslide extraction algorithm based on improved U-net model. Remote sensing, 12(5): 894 [DOI: 10.3390/rs12050894http://dx.doi.org/10.3390/rs12050894]

Liu Y and Wu L Z. 2016. Geological disaster recognition on optical remote sensing images using deep learning. Procedia Computer Science, 91: 566-575 [DOI: 10.1016/j.procs.2016.07.144http://dx.doi.org/10.1016/j.procs.2016.07.144]

Mondini A C, Guzzetti F, Reichenbach P, Rossi M, Cardinali M and Ardizzone F. 2011. Semi-automatic recognition and mapping of rainfall induced shallow landslides using optical satellite images. Remote Sensing of Environment, 115(7): 1743-1757 [DOI: 10.1016/j.rse.2011.03.006http://dx.doi.org/10.1016/j.rse.2011.03.006]

Pan S J and Yang Q. 2010. A survey on transfer learning. IEEE Transactions on Knowledge and Data Engineering, 22(10): 1345-1359 [DOI: 10.1109/tkde.2009.191http://dx.doi.org/10.1109/tkde.2009.191]

Penatti O A B, Nogueira K and Santos J A D. 2015. Do deep features generalize from everyday objects to remote sensing and aerial scenes domains?//Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops. Boston: IEEE: 44-51 [DOI: 10.1109/CVPRW.2015.7301382http://dx.doi.org/10.1109/CVPRW.2015.7301382]

Peng L, Xu S N, Mei J J and Su F H. 2017. Earthquake-induced landslide recognition using high-resolution remote sensing images. Journal of Remote Sensing, 21(4): 509-518

彭令, 徐素宁, 梅军军, 苏凤环. 2017. 地震滑坡高分辨率遥感影像识别. 遥感学报, 21(4): 509-518 [DOI: 10.11834/jrs.20176176http://dx.doi.org/10.11834/jrs.20176176]

Raina R, Ng A Y and Koller D. 2006. Constructing informative priors using transfer learning//Proceedings of the 23rd International Conference on Machine Learning. Pittsburgh: ACM: 713-720 [DOI: 10.1145/1143844.1143934http://dx.doi.org/10.1145/1143844.1143934]

Shvets A A, Rakhlin A, Kalinin A A and Iglovikov V I. 2018. Automatic instrument segmentation in robot-assisted surgery using deep learning//2018 17th IEEE International Conference on Machine Learning and Applications (ICMLA). Orlando: IEEE: 624-628 [DOI: 10.1109/ICMLA.2018.00100http://dx.doi.org/10.1109/ICMLA.2018.00100]

Su F H, Liu H J and Han Y S. 2008. The extraction of mountain hazard induced by Wenchuan earthquake and analysis of its distributing characteristic. Journal of Remote Sensing, 12(6): 956-963

苏凤环, 刘洪江, 韩用顺. 2008. 汶川地震山地灾害遥感快速提取及其分布特点分析. 遥感学报, 12(6): 956-963 [DOI: 10.11834/jrs.200806128http://dx.doi.org/10.11834/jrs.200806128]

Wang Y, Wang X F and Jian J F. 2019. Remote sensing landslide recognition based on convolutional neural network. Mathematical Problems in Engineering, 2019: 8389368 [DOI: 10.1155/2019/8389368http://dx.doi.org/10.1155/2019/8389368]

Wang Y, Yang Y, Wang B S, Wang T, Bu X H and Wang C Y. 2019. Building segmentation in high-resolution remote sensing image through deep neural network and conditional random fields. Journal of Remote Sensing, 23(6): 1194-1208

王宇, 杨艺, 王宝山, 王田, 卜旭辉, 王传云. 2019. 深度神经网络条件随机场高分辨率遥感图像建筑物分割. 遥感学报, 23(6): 1194-1208 [DOI: 10.11834/jrs.20198141http://dx.doi.org/10.11834/jrs.20198141]

Wang Z H. 1999. Reviewing and prospecting for applying remote sensing to landslide and debris flow investigation. Remote Sensing for Land and Resources, 41(3): 10-15, 39

王治华. 1999. 滑坡、泥石流遥感回顾与新技术展望. 国土资源遥感, 41(3): 10-15, 39 [DOI: 10.3969/j.issn.1001-070X.1999.03.004http://dx.doi.org/10.3969/j.issn.1001-070X.1999.03.004]

Ye R Q, Deng Q L and Wang H Q. 2007. Landslides identification based on image classification: a case study on Guizhoulaocheng landslide in the three gorges reservoir area. Chinese Journal of Engineering Geophysics, 4(6): 574-577

叶润青, 邓清禄, 王海庆. 2007. 基于图像分类方法滑坡识别与特征提取——以归州老城滑坡为例. 工程地球物理学报, 4(6): 574-577 [DOI: 10.3969/j.issn.1672-7940.2007.06.012http://dx.doi.org/10.3969/j.issn.1672-7940.2007.06.012]

Yin J, Yang Q and Ni L. 2005. Adaptive temporal radio maps for indoor location estimation//Third IEEE International Conference on Pervasive Computing and Communications. Kauai: IEEE: 85-94 [DOI: 10.1109/PERCOM.2005.7http://dx.doi.org/10.1109/PERCOM.2005.7]

Yu H, Ma Y, Wang L F, Zhai Y S and Wang X Q. 2017. A landslide intelligent detection method based on CNN and RSG_R//2017 IEEE International Conference on Mechatronics and Automation (ICMA). Takamatsu: IEEE: 40-44 [DOI: 10. 1109/ICMA. 2017. 8015785http://dx.doi.org/10.1109/ICMA.2017.8015785]

Alert me when the article has been cited

提交

Transferring deep convolutional neural network models for generalization mapping of autumn crops

Evapotranspiration estimation and validation at 16 m resolution based on ETMonitor model driven by GF-1 satellite remote sensing datasets

GF-1 leaf area index product across China based on three-dimensional stochastic radiation transfer model

Retrieving canopy closure of Yunnan pine forests by using stochastic radiative transfer model

Remote sensing of total suspended matter concentration and turbidity in a macrophytic lake