Attention-based feature pyramid networks for ship detection of optical remote sensing image

Ye YU; Hua AI; Xiaojun HE; Shuhai YU; Xing ZHONG; Ruifei ZHU

doi:10.11834/jrs.20208264

Chinese Satellites | Views : 0 下载量: 1875 CSCD: 15

PDF
Export
Share
Collection
Album

Attention-based feature pyramid networks for ship detection of optical remote sensing image
Vol. 24, Issue 2, Pages: 107-115(2020)
Received：06 July 2018，

Published：07 February 2020
DOI： 10.11834/jrs.20208264
稿件说明：

移动端阅览

于野，艾华，贺小军，于树海，钟兴，朱瑞飞.2020.A-FPN算法及其在遥感图像船舶检测中的应用.遥感学报，24（2）： 107-115 DOI： 10.11834/jrs.20208264.

YU Ye,AI Hua,HE Xiaojun,YU Shuhai,ZHONG Xing,ZHU Ruifei. 2020. Attention-based feature pyramid networks for ship detection of optical remote sensing image. National Remote Sensing Bulletin. 24(2): 107-115 DOI： 10.11834/jrs.20208264.

摘要

光学遥感图像船舶检测主要面临两个挑战：光学遥感图像背景复杂，船舶检测易受海浪、云雾及陆地建筑等多方面干扰；遥感图像分辨率低，船舶目标小，对于其分类与定位带来很大困难；针对上述问题，在FPN的基础上，提出一种融入显著性特征的卷积神经网络模型A-FPN（Attention-Based Feature Pyramid Networks ）。首先，利用卷积提取图像特征金字塔；然后，利用顶层金字塔逐级构建显著特征层，抑制背景信息，通过金字塔顶层的细粒度特征提高浅层特征的表达能力，构建自上而下的多级显著特征映射结构；最后利用Softmax分类器进行多层级船舶检测。A-FPN模型利用显著性机制引导不同感受下的特征进行融合，提高了模型的分辨能力，对遥感图像处理领域具有重要应用价值。实验阶段，利用公开的遥感目标检测数据集NWPU VHR-10中的船舶样本进行测试，准确率为92.8%，表明A-FPN模型适用于遥感图像船舶检测。

Abstract

Ship detection on spaceborne optical images is a challenging task that has attracted increasing attention because of its potential applications in many fields. Although some ship detection methods have been proposed in recent years

many obstacles still exist because of the large-scale and high complexity of optical remote sensing images. Identifying ships from interferences

such as the features of clouds

waves

and some land architectures that are similar to ships

is difficult. Therefore

an accurate and stable deep-learning based method is proposed in this work.

The method involves three steps: First

the image feature pyramid is extracted using convolution to detect multiscale ship targets. Second

a multilevel attention feature mapping structure is constructed from top to bottom using the fine-grained features of the top layer from the pyramid to improve the expressive ability of shallow features. Finally

Softmax classifier is used for multilevel ship detection.

The experimental results based on real remote sensing images are shot by “JL-1” satellite

Google satellite

and NWPU VHR-10. The result proves that the performance of our algorithm is better than the three other state-of-the-art methods. In addition

the network was cut while ensuring accuracy. The complexity of our algorithm is reduced

and its practicality is improved by experiments and analysis.

This work proposes an attention-based method called A-FPN. However

unlike traditional algorithms

A-FPN has higher robustness and wider range of use. Furthermore

we effectively cut the network to reduce the complexity of the algorithm

thereby exhibiting the significance of our algorithm in practical applications.

关键词

Keywords

references

Cai Z W , Fan Q F , Feris R S and Vasconcelos N . 2016 . A unified multi-scale deep convolutional neural network for fast object detection // Proceedings of the 14th European Conference on Computer Vision . Amsterdam, The Netherlands : Springer [ DOI: 10.1007/978-3-319-46493-0_22 http://dx.doi.org/10.1007/978-3-319-46493-0_22 ]

Chen P , Liu R Y and Huang W G . 2010 . A ship detection model based on multi-distribution on SAR imagery . Journey of Remote Sensing . 14 ( 3 ): 546 - 557

陈鹏，刘仁义，黄韦艮 . 2010 . SAR图像复合分布船只检测模型 . 遥感学报， 14 ( 3 )： 546- 557 [ DOI: 10.11834/jrs.20100312 http://dx.doi.org/10.11834/jrs.20100312 ]

Cheng G , Han J W , Zhou P C and Guo L . 2014 . Multi-class geospatial object detection and geographic image classification based on collection of part detectors . ISPRS Journal of Photogrammetry and Remote Sensing , 98 : 119 - 132 [ DOI: 10.1016/j.isprsjprs.2014.10.002 http://dx.doi.org/10.1016/j.isprsjprs.2014.10.002 ]

Corbane C , Najman L , Pecoul E , Demagistri L and Petit M . 2010 . A complete processing chain for ship detection using optical satellite imagery . International Journal of Remote Sensing , 31 ( 22 ): 5837 - 5854 [ DOI: 10.1080/01431161.2010.512310 http://dx.doi.org/10.1080/01431161.2010.512310 ]

Dai J F , Li Y , He K M and Sun J . 2016 . R-FCN: object detection via region-based fully convolutional networks // Proceedings of the 30th International Conference on Neural Information Processing Systems . Barcelona, Spain : Curran Associates Inc

Fu J , Zheng H , Mei T . Look closer to see better: Recurrent attention convolutional neural network for fine-grained image recognition [C]// Proceedings of the IEEE conference on computer vision and pattern recognition . 2017 : 4438 - 4446 .

Girshick R , Donahue J , Darrell T and Malik J . 2014 . Rich feature hierarchies for accurate object detection and semantic segmentation // Proceedings of 2014 IEEE Conference on Computer Vision and Pattern Recognition . Columbus, OH, USA : IEEE : 580 - 587 [ DOI: 10.1109/CVPR.2014.81 http://dx.doi.org/10.1109/CVPR.2014.81 ]

Girshick R . 2015 . Fast R-CNN // Proceedings of the IEEE International Conference on Computer Vision . Santiago, Chile : IEEE [ DOI: 10.1109/ICCV.2015.169 http://dx.doi.org/10.1109/ICCV.2015.169 ]

He K M , Gkioxari G , Dollár P and Girshick R . 2017 . Mask R-CNN // Proceedings of 2017 IEEE International Conference on Computer Vision . Venice, Italy : IEEE [ DOI: 10.1109/ICCV.2017.322 http://dx.doi.org/10.1109/ICCV.2017.322 ]

He K M , Zhang X Y , Ren S Q and Sun J . 2016 . Deep residual learning for image recognition // Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition . Las Vegas, NV, USA : IEEE : 770 - 778 [ DOI: 10.1109/CVPR.2016.90 http://dx.doi.org/10.1109/CVPR.2016.90 ]

Hinton G E and Salakhutdinov R R . 2006 . Reducing the dimensionality of data with neural networks . Science , 313 ( 5786 ): 504 - 507 [ DOI: 10.1126/science.1127647 http://dx.doi.org/10.1126/science.1127647 ]

Kong T , Sun F C , Yao A B , Liu H P , Lu M and Chen Y R . 2017 . RON: reverse connection with objectness prior networks for object detection // Proceedings of 2017 IEEE Conference on Computer Vision and Pattern Recognition . Honolulu, HI, USA : IEEE [ DOI: 10.1109/CVPR.2017.557 http://dx.doi.org/10.1109/CVPR.2017.557 ]

LeCun Y , Bengio Y and Hinton G . 2015 . Deep learning . Nature , 521 ( 7553 ): 436 - 444 [ DOI: 10.1038/nature14539 http://dx.doi.org/10.1038/nature14539 ]

Lin H N , Shi Z W and Zou Z X . 2017c . Fully convolutional network with task partitioning for inshore ship detection in optical remote sensing images . IEEE Geoscience and Remote Sensing Letters , 14 ( 10 ): 1665 - 1669 [ DOI: 10.1109/LGRS.2017.2727515 http://dx.doi.org/10.1109/LGRS.2017.2727515 ]

Lin T Y , Dollár P , Girshick R , He K M , Hariharan B and Belongie S . 2017a . Feature pyramid networks for object detection // Proceedings of 2017 IEEE Conference on Computer Vision and Pattern Recognition . Honolulu, HI, USA : IEEE [ DOI: 10.1109/CVPR.2017.106 http://dx.doi.org/10.1109/CVPR.2017.106 ]

Lin T Y , Goyal P , Girshick R , He K M and Dollár P . 2017b . Focal loss for dense object detection // Proceedings of 2017 IEEE International Conference on Computer Vision . Venice, Italy : IEEE [ DOI: 10.1109/ICCV.2017.324 http://dx.doi.org/10.1109/ICCV.2017.324 ]

Liu W , Anguelov D , Erhan D , Szegedy C , Reed S , Fu C Y and Berg A C . 2016 . SSD: single shot multibox detector // Proceedings of the 14th European Conference on Computer Vision . Amsterdam, The Netherlands : Springer [ DOI: 10.1007/978-3-319-46448-0_2 http://dx.doi.org/10.1007/978-3-319-46448-0_2 ]

Lure F Y M and Rau Y C . 1994 . Detection of ship tracks in AVHRR cloud imagery with neural networks // Proceedings of 1994 IEEE International Geoscience and Remote Sensing Symposium . Pasadena : IEEE : 1401 - 1403 [ DOI: 10.1109/IGARSS.1994.399451 http://dx.doi.org/10.1109/IGARSS.1994.399451 ]

Qi S X , Ma J , Lin J , Li Y S and Tian J W . 2015 . Unsupervised ship detection based on saliency and S-HOG descriptor from optical satellite images . IEEE Geoscience and Remote Sensing Letters , 12 ( 7 ): 1451 - 1455 [ DOI: 10.1109/LGRS.2015.2408355 http://dx.doi.org/10.1109/LGRS.2015.2408355 ]

Redmon J and Farhadi A . 2018 . Yolov3: an incremental improvement . arXiv preprint arXiv : 1804 . 02767

Redmon J , and Farhadi A . 2017 . YOLO9000 : better, faster, stronger// Proceedings of 2017 IEEE Conference on Computer Vision and Pattern Recognition . Honolulu, HI, USA : IEEE [ DOI: 10.1109/CVPR.2017.690 http://dx.doi.org/10.1109/CVPR.2017.690 ]

Ren S Q , He K M , Girshick R and Sun J . 2015 . Faster R-CNN: towards real-time object detection with region proposal networks // Proceedings of the 28th International Conference on Neural Information Processing Systems . Montreal, Canada : MIT Press : 91 - 99

Suleymanova I , Balassa T , Tripathi S , Molnar C , Saarma M , Sidorova Y and Horvath P . 2018 . A deep convolutional neural network approach for astrocyte detection . Scientific Reports , 8 : 12878 [ DOI: 10.1038/s41598-018-31284-x http://dx.doi.org/10.1038/s41598-018-31284-x ]

Tian S R , Sun G Y , Wang C and Zhang H . 2007 . A Ship detection method in SAR image based on gravity enhancement . Journey of Remote Sensing . 11 ( 4 ): 452 - 459

田巳睿，孙根云，王超，张红 . 2007 . 基于引力场增强的SAR图像船舶检测方法研究 . 遥感学报， 11 ( 4 )： 452- 459 [ DOI: 10.11834/jrs.20070463 http://dx.doi.org/10.11834/jrs.20070463 ]

Wang H , Wang Q L , Gao M Q , Li P H and Zuo W M . 2018 . Multi-scale location-aware kernel representation for object detection // Proceedings of 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition . Salt Lake City, UT, USA : IEEE [ DOI: 10.1109/CVPR.2018.00136 http://dx.doi.org/10.1109/CVPR.2018.00136 ]

Wang F , Jiang M , Qian C , et al . Residual attention network for image classification [C]// Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition . 2017 : 3156 - 3164 .

Yang G , Li B , Ji S F , Gao F and Xu Q Z . 2014 . Ship detection from optical satellite images based on sea surface analysis . IEEE Geoscience and Remote Sensing Letters , 11 ( 3 ): 641 - 645 [ DOI: 10.1109/LGRS.2013.2273552 http://dx.doi.org/10.1109/LGRS.2013.2273552 ].

Alert me when the article has been cited

提交

Identification and dynamic monitoring of invasive Spartina alterniflora control methods based on time series Sentinel-2 and Landsat 8 imagery

Application efficiency of multisource optical remote sensing data for marine oil spill monitoring

GF-7 satellite imagery DSM improvement by fusing laser altimetry data without ground control points in mining areas

Remote sensing inversion method for offshore water depth considering geographical location characteristics

A neural network-based model for compensation of inversion errors in satellite-borne GNSS-R sea surface heights