Airborne Multi-Dimensional SAR Land Cover Dataset and Fusion Classification Method

Zheng Nai-Rong; Yang Zi-An; Shi Xian-Zheng; Yang Hong; Sun Yue; Wang Feng

doi:10.11834/jrs.20242276

Views : 0 下载量: 27 CSCD: 0 更多指标

R-PDF
PDF
Export
Share
Collection
Album

Airborne Multi-Dimensional SAR Land Cover Dataset and Fusion Classification Method
Pages: 1-15(2024)
Published Online： 06 March 2024 ，
DOI： 10.11834/jrs.20242276

扫描看全文

郑乃榕，杨子安，施贤正，杨宏，孙越，王峰.XXXX.机载多维度SAR图像地物数据集构建及融合分类方法研究.遥感学报，XX（XX）： 1-15

Zheng Nai-Rong，Yang Zi-An，Shi Xian-Zheng，Yang Hong，Sun Yue，Wang Feng. XXXX. Airborne Multi-Dimensional SAR Land Cover Dataset and Fusion Classification Method. National Remote Sensing Bulletin， XX（XX）：1-15
郑乃榕，杨子安，施贤正，杨宏，孙越，王峰.XXXX.机载多维度SAR图像地物数据集构建及融合分类方法研究.遥感学报，XX（XX）： 1-15 DOI： 10.11834/jrs.20242276.

Zheng Nai-Rong，Yang Zi-An，Shi Xian-Zheng，Yang Hong，Sun Yue，Wang Feng. XXXX. Airborne Multi-Dimensional SAR Land Cover Dataset and Fusion Classification Method. National Remote Sensing Bulletin， XX（XX）：1-15 DOI： 10.11834/jrs.20242276.

摘要

随着合成孔径雷达（SAR：Synthetic Aperture Radar）成像和深度学习技术的发展，利用深度学习算法对SAR图像进行地物分类得到了广泛关注及应用研究。本文基于对地观测航空遥感系统高分机载数据构建了高分辨率机载多维度SAR地物分类数据集（AIR-MDSAR-Map： Airborne Multi-Dimensional Synthetic Aperture Radar Mapping Dataset）。本数据集包含海南万宁和江苏射阳两个区域的P、L、S、C、Ka五个波段的多极化 SAR 图像和高分辨率光学图像，将地物划分为水域、裸地、道路、工业区、林草地、住宅区、种植地、养殖场和其他等9类，并提供精细化的像素级别标签。本文利用深度学习中较经典的语义分割方法对 AIR-MDSAR-Map 进行地物分类验证，同时也检验了不同波段SAR图像对各类地物的分类敏感性。最后，通过不同的融合策略对多维度SAR数据进行融合分类，最终融合方法在其中多类地物目标上的表现优于单波段，在综合指标FWIoU和PA上提升10~15%，FWIoU达69%，PA达81%。该数据集将发布于国家综合地球观测数据共享平台（

http：//www.chinageoss.cn

http://www.chinageoss.cn

），能满足不同行业用户和科研用户的需求，为多维度SAR数据的应用研究提供支撑。

Abstract

With the development of Synthetic Aperture Radar (SAR) imaging and deep learning

the use of deep learning to classify land cover in SAR images has received extensive attention and applied research. In this paper

a high-resolution airborne multi-dimensional SAR land cover classification dataset is constructed based on the high-resolution airborne data of the Chinese Aeronautic Remote Sensing System (CARSS) for Earth observation

whose name is AIR-MDSAR-Map (Airborne Multi-Dimensional Synthetic Aperture Radar Mapping Dataset).The original data are obtained by CARSS

and the platform is a modified Xinzhou 60 remote sensing aircraft. SAR images and optical images are generated according to the standard data production process. After imaging processing

radiometric correction

polarization correction

and geometric correction

the original SAR data are preprocessed to form SLC data

and then geometric processing is used to generate SAR DOM products. After image enhancement

splicing

and rough correction

the raw optical data are preprocessed to generate DSM data

and then semi-automatic filtering is performed to produce DEM. Finally

AIR-MDSAR-Map contains polarization SAR images in bands of C

and S and high-resolution optical images in Wanning

Hainan

and Sheyang

Jiangsu

with the spatial resolution ranging from 0.2 m to 1 m depending on the band.AIR-MDSAR-Map divides the land cover into nine categories and generates fine pixel-level labels through a semi-automatic labeling algorithm. In this paper

the classical semantic segmentation methods in deep learning

such as UNet

SegNet

Deeplab

and HRNet

are used to verify the classification of AIR-MDSAR-Map. At the same time

we also test the classification sensitivity of different band images to all kinds of land cover objects.This dataset includes multi-dimensional SAR images of the same place and time

which can be used for fusion classification research. In this paper

multi-dimensional SAR data are fused and classified through different fusion strategies

model fusion classifies land cover by selectively fusing the models of each band

and the priori fusion uses the prior information of the classification results in each band to distinguish land cover on defining the priority of objects. These two fusion methods outperform the single-band in the performance of some types of land cover

and improve the FWIoU and PA by 10~15%

the FWIoU reaches 69%

and PA is 81%.AIR-MDSAR-Map can satisfy the research and application requirements of different users and can be used to study the characteristics of the same land cover object with different resolutions

bands

and polarizations. Moreover

it can provide a strong promotion for the development of multi-dimensional SAR applications. The AIR-MDSAR-Map will be available at the ChinaGEOSS Data Sharing Network (

http://www.chinageoss.cn

关键词

机载SAR多维度地物分类深度学习语义分割AIR-MDSAR-Map

Keywords

airborne SARmulti-dimensionalland cover classificationdeep learningsemantic segmentationAIR-MDSAR-Map

references

Addabbo P., M. Focareta, S. Marcuccio, C. Votto, and S. L. Ullo. 2016. Land cover classification and monitoring through multisensor image and data combination. Paper presented at the 2016 IEEE International Geoscience and Remote Sensing Symposium (IGARSS), 10-15 July 2016.

Badrinarayanan V., A. Kendall, and R. Cipolla. 2017. SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 39 (12):2481-95. [doi: 10.1109/TPAMI.2016.2644615http://dx.doi.org/10.1109/TPAMI.2016.2644615]

Chen L. C., Yukun Zhu, George Papandreou, Florian Schroff, and Hartwig Adam. 2018. Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation. Paper presented at the Computer Vision – ECCV 2018, Cham, 2018//.

Chen L., G. Papandreou, I. Kokkinos, K. Murphy, and A. L. Yuille. 2018. DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs. IEEE Transactions on Pattern Analysis and Machine Intelligence, 40 (4):834-48. [doi: 10.1109/TPAMI.2017.2699184http://dx.doi.org/10.1109/TPAMI.2017.2699184]

Chen Q., G. Kuang, J. Li, L. Sui, and D. Li. 2013. Unsupervised Land Cover/Land Use Classification Using PolSAR Imagery Based on Scattering Similarity. IEEE Transactions on Geoscience and Remote Sensing, 51 (3):1817-25. [doi: 10.1109/TGRS.2012.2205389http://dx.doi.org/10.1109/TGRS.2012.2205389]

Cloude S. R., and E. Pottier. 1996. A review of target decomposition theorems in radar polarimetry. IEEE Transactions on Geoscience and Remote Sensing, 34 (2):498-518. [doi: 10.1109/36.485127http://dx.doi.org/10.1109/36.485127]

Deng J., W. Dong, R. Socher, L. Li, Li Kai, and Fei-Fei Li. 2009. ImageNet: A large-scale hierarchical image database. Paper presented at the 2009 IEEE Conference on Computer Vision and Pattern Recognition, 20-25 June 2009.

Dierking W., and T. Busche. 2006. Sea ice monitoring by L-band SAR: an assessment based on literature and comparisons of JERS-1 and ERS-1 imagery. IEEE Transactions on Geoscience and Remote Sensing, 44 (4):957-70. [doi: 10.1109/TGRS.2005.861745http://dx.doi.org/10.1109/TGRS.2005.861745]

Freeman A., and S. L. Durden. 1998. A three-component scattering model for polarimetric SAR data. IEEE Transactions on Geoscience and Remote Sensing, 36 (3):963-73. [doi: 10.1109/36.673687http://dx.doi.org/10.1109/36.673687]

He K., X. Zhang, S. Ren, and J. Sun. 2016. Deep Residual Learning for Image Recognition. Paper presented at the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 27-30 June 2016.

Howard, Andrew G., Menglong Zhu, Bo Chen, Dmitry Kalenichenko, Weijun Wang, Tobias Weyand, Marco Andreetto, and Hartwig Adam. 2017. Mobilenets: Efficient convolutional neural networks for mobile vision applications. arXiv preprint arXiv:1704.04861.

Huang G., Z. Liu, L. Van Der Maaten, and K. Q. Weinberger. 2017. Densely Connected Convolutional Networks. Paper presented at the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 21-26 July 2017.

Long J., E. Shelhamer, and T. Darrell. 2015. Fully convolutional networks for semantic segmentation. Paper presented at the 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 7-12 June 2015.

Lv, Qi, Yong Dou, Xin Niu, Jiaqing Xu, Jinbo Xu, and Fei Xia. 2015. Urban Land Use and Land Cover Classification Using Remotely Sensed SAR Data through Deep Belief Networks. Journal of Sensors, 2015:538063. [doi: 10.1155/2015/538063http://dx.doi.org/10.1155/2015/538063]

Mishra P., and D. Singh. 2014. A Statistical-Measure-Based Adaptive Land Cover Classification Algorithm by Efficient Utilization of Polarimetric SAR Observables. IEEE Transactions on Geoscience and Remote Sensing, 52 (5):2889-900. [doi: 10.1109/TGRS.2013.2267548http://dx.doi.org/10.1109/TGRS.2013.2267548]

Moreira A., P. Prats-Iraola, M. Younis, G. Krieger, I. Hajnsek, and K. P. Papathanassiou. 2013. A tutorial on synthetic aperture radar. IEEE Geoscience and Remote Sensing Magazine, 1 (1):6-43. [doi: 10.1109/MGRS.2013.2248301http://dx.doi.org/10.1109/MGRS.2013.2248301]

O’Mahony, Niall, Sean Campbell, Anderson Carvalho, Suman Harapanahalli, Gustavo Velasco Hernandez, Lenka Krpalkova, Daniel Riordan, and Joseph Walsh. 2020. Deep Learning vs. Traditional Computer Vision. Paper presented at the Advances in Computer Vision, Cham, 2020//.

Ronneberger, Olaf, Philipp Fischer, and Thomas Brox. 2015. U-net: Convolutional networks for biomedical image segmentation. Paper presented at the International Conference on Medical image computing and computer-assisted intervention.

Shimoni M., D. Borghys, R. Heremans, C. Perneel, and M. Acheroy. 2009. Fusion of PolSAR and PolInSAR data for land cover classification. International Journal of Applied Earth Observation and Geoinformation, 11 (3):169-80. [doi: https://doi.org/10.1016/j.jag.2009.01.004https://doi.org/10.1016/j.jag.2009.01.004]

Simonyan K., and A. Zisserman. 2015. Very deep convolutional networks for large-scale image recognition. Paper presented at the 3rd International Conference on Learning Representations, ICLR 2015 - Conference Track Proceedings.

Song, Yuheng, and Hao Yan. 2017. Image segmentation algorithms overview. arXiv preprint arXiv:1707.02051.

Sukawattanavijit C., J. Chen, and H. Zhang. 2017. GA-SVM Algorithm for Improving Land-Cover Classification Using SAR and Optical Remote Sensing Data. IEEE Geoscience and Remote Sensing Letters, 14 (3):284-8. [doi: 10.1109/LGRS.2016.2628406http://dx.doi.org/10.1109/LGRS.2016.2628406]

Sun K., B. Xiao, D. Liu, and J. Wang. 2019. Deep High-Resolution Representation Learning for Human Pose Estimation. Paper presented at the 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 15-20 June 2019.

Tong, Xin-Yi, Gui-Song Xia, Qikai Lu, Huanfeng Shen, Shengyang Li, Shucheng You, and Liangpei Zhang. 2020. Land-cover classification with high-resolution remote sensing images using transferable deep models. Remote Sensing of Environment, 237:111322. [doi: https://doi.org/10.1016/j.rse.2019.111322https://doi.org/10.1016/j.rse.2019.111322]

Wang J., K. Sun, T. Cheng, B. Jiang, C. Deng, Y. Zhao, D. Liu, et al. 2021. Deep High-Resolution Representation Learning for Visual Recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, 43 (10):3349-64. [doi: 10.1109/TPAMI.2020.2983686http://dx.doi.org/10.1109/TPAMI.2020.2983686]

Wang Z., X. Zeng, Z. Yan, J. Kang, and X. Sun. 2022. AIR-PolSAR-Seg: A Large-Scale Data Set for Terrain Segmentation in Complex-Scene PolSAR Images. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 15:3830-41. [doi: 10.1109/JSTARS.2022.3170326http://dx.doi.org/10.1109/JSTARS.2022.3170326]

Zhao, Qi, Jiahui Liu, Yuewen Li, and Hong Zhang. 2021. Semantic Segmentation With Attention Mechanism for Remote Sensing Images. IEEE Transactions on Geoscience and Remote Sensing, PP:1-13. [doi: 10.1109/TGRS.2021.3085889http://dx.doi.org/10.1109/TGRS.2021.3085889]

Zheng, Nai-Rong, Zi-An Yang, and Feng Wang. 2022. Semi-automatic Annotation Method for Semantic Segmentation of Synthetic Aperture Radar Images. Paper presented at the Proceedings of the 8th China High Resolution Earth Observation Conference (CHREOC 2022).

Zhong, Yanfei, Xin Hu, Chang Luo, Xinyu Wang, Ji Zhao, and Liangpei Zhang. 2020. WHU-Hi: UAV-borne hyperspectral with high spatial resolution (H2) benchmark datasets and classifier for precise crop identification based on deep convolutional neural network with CRF. Remote Sensing of Environment, 250:112012. [doi: https://doi.org/10.1016/j.rse.2020.112012https://doi.org/10.1016/j.rse.2020.112012]

Yi Cen, Lifu Zhang, Xia Zhang, Yueming Wang, Wenchao Qi, Senlin Tang and Peng Zhang. 2020. Aerial hyperspectral remote sensing classification dataset of Xiongan New Area (Matiwan Village).Journal of Remote Sensing (Chinese), 24 (11):1299-306.

岑奕, 张立福, 张霞, 王跃明, 戚文超, 汤森林, 张鹏. 2020. 雄安新区马蹄湾村航空高光谱遥感影像分类数据集.遥感学报, 24 (11):1299-306.

Baiming Chen and Xiaoping Zhou. 2007. Explanation of Current Land Use Condition Classification for National Standard of the People's Republic of China.Journal of Natural Resources, (06):994-1003.

陈百明, 周小萍. 2007. 《土地利用现状分类》国家标准的解读.自然资源学报, (06):994-1003.

Jiyan Fan, Changqing Ke, Guohui Yao and Zifei Wang. 2022. Identification of glaciers using fully polarimetric SAR data based on deep-learning.National Remote Sensing Bulletin:1-18.

范吉延, 柯长青, 姚国慧, 王梓霏. 2022. 基于深度学习的全极化SAR影像冰川边界识别.遥感学报:1-18. [doi: 10.11834/jrs.20221541http://dx.doi.org/10.11834/jrs.20221541]

Dan Wei, Yuan Li and Dan Huang. 2020. Overview on Methods of Land Classification Based on Polarimetric SAR Images.Computer System and Applications, 29 (11):29-39.

魏丹, 李渊, 黄丹. 2020. 极化SAR图像地物分类方法综述.计算机系统应用, 29 (11):29-39. [doi: 10.15888/j.cnki.csa.007705http://dx.doi.org/10.15888/j.cnki.csa.007705]

Fan Wu, Hong Zhang, Chao Wang, Lu Li, Juanjuan Li, Weirong Chen and Bo Zhang. 2022. SARBuD1.0： A SAR building dataset based on GF-3 FSII imageries for built-up area extraction with deep learning method.National Remote Sensing Bulletin, 26 (4):620-31.

吴樊, 张红, 王超, 李璐, 李娟娟, 陈卫荣, 张波. 2022. SARBuD 1.0：面向深度学习的GF-3 精细模式SAR建筑数据集.遥感学报, 26 (4):620-31. [doi: 10.11834/jrs.20220296http://dx.doi.org/10.11834/jrs.20220296]

Yirong Wu. 2013. Concept of Multidimensional Space Joint-observation SAR.Journal of Radars, 2 (02):135-42.

吴一戎. 2013. 多维度合成孔径雷达成像概念.雷达学报, 2 (02):135-42.

Alert me when the article has been cited

提交

SARBuD1.0： A SAR building dataset based on GF-3 FSII imageries for built-up area extraction with deep learning method

Point cloud benchmark dataset WHU-TLS and WHU-MLS for deep learning

Edge-perception Enhanced Segmentation Method for High-resolution Remote Sensing Image

SAR ship detection through generative knowledge transfer

MtSCCD： Land-use scene classification and change-detection dataset for deep learning