Attention-based feature pyramid networks for ship detection of optical remote sensing image

  • role: First author第一作者
  • Affiliation:

    Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun 130033, China

    University of Chinese Academy of Sciences, Beijing 100049, China

  • Email:957458545@qq.com
  • Introduction:于野,1992年生,男,博士研究生,研究方向为光学遥感图像处理、目标检测与识别。E-mail: 957458545@qq.com
YU Ye12,  
  • Affiliation:

    Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun 130033, China

AI Hua1,  
  • role: Corresponding author通信作者
  • Affiliation:

    Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun 130033, China

    Chang Guang Satellite Technology Co., Ltd., Changchun 130102, China

  • Email:hexiaojun6@163.com
  • Introduction:贺小军,1983年生,男,副研究员,研究方向为光学卫星总体技术及遥感图像处理技术。E-mail: hexiaojun6@163.com
HE Xiaojun13*,  
  • Affiliation:

    Chang Guang Satellite Technology Co., Ltd., Changchun 130102, China

YU Shuhai3,  
  • Affiliation:

    Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun 130033, China

    Chang Guang Satellite Technology Co., Ltd, Key Laboratory of Satellite Remote Sensing Application Technology of Jilin Province, Changchun 130039, China

ZHONG Xing14,  
  • Affiliation:

    Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun 130033, China

    Chang Guang Satellite Technology Co., Ltd, Key Laboratory of Satellite Remote Sensing Application Technology of Jilin Province, Changchun 130039, China

ZHU Ruifei14

résumé

Ship detection on spaceborne optical images is a challenging task that has attracted increasing attention because of its potential applications in many fields. Although some ship detection methods have been proposed in recent years, many obstacles still exist because of the large-scale and high complexity of optical remote sensing images. Identifying ships from interferences, such as the features of clouds, waves, and some land architectures that are similar to ships, is difficult. Therefore, an accurate and stable deep-learning based method is proposed in this work.The method involves three steps: First, the image feature pyramid is extracted using convolution to detect multiscale ship targets. Second, a multilevel attention feature mapping structure is constructed from top to bottom using the fine-grained features of the top layer from the pyramid to improve the expressive ability of shallow features. Finally, Softmax classifier is used for multilevel ship detection.The experimental results based on real remote sensing images are shot by “JL-1” satellite, Google satellite, and NWPU VHR-10. The result proves that the performance of our algorithm is better than the three other state-of-the-art methods. In addition, the network was cut while ensuring accuracy. The complexity of our algorithm is reduced, and its practicality is improved by experiments and analysis.This work proposes an attention-based method called A-FPN. However, unlike traditional algorithms, A-FPN has higher robustness and wider range of use. Furthermore, we effectively cut the network to reduce the complexity of the algorithm, thereby exhibiting the significance of our algorithm in practical applications.

mots-clés

optical remote sensing;ship detection;JL-1 satellite;neural network;attention features

References

  1. 1.
    Cai Z W, Fan Q F, Feris R S and Vasconcelos N. 2016. A unified multi-scale deep convolutional neural network for fast object detection//Proceedings of the 14th European Conference on Computer Vision. Amsterdam, The Netherlands: Springer
  2. 2.
    Chen P, Liu R Y and Huang W G. 2010. A ship detection model based on multi-distribution on SAR imagery. Journey of Remote Sensing. 14(3): 546-557
  3. 3.
    Cheng G, Han J W, Zhou P C and Guo L. 2014. Multi-class geospatial object detection and geographic image classification based on collection of part detectors. ISPRS Journal of Photogrammetry and Remote Sensing, 98: 119-132
  4. 4.
    Corbane C, Najman L, Pecoul E, Demagistri L and Petit M. 2010. A complete processing chain for ship detection using optical satellite imagery. International Journal of Remote Sensing, 31(22): 5837-5854
  5. 5.
    Dai J F, Li Y, He K M and Sun J. 2016. R-FCN: object detection via region-based fully convolutional networks//Proceedings of the 30th International Conference on Neural Information Processing Systems. Barcelona, Spain: Curran Associates Inc
  6. 6.
    Fu J, Zheng H, Mei T. Look closer to see better: Recurrent attention convolutional neural network for fine-grained image recognition[C]//Proceedings of the IEEE conference on computer vision and pattern recognition. 2017: 4438-4446.
  7. 7.
    Girshick R, Donahue J, Darrell T and Malik J. 2014. Rich feature hierarchies for accurate object detection and semantic segmentation//Proceedings of 2014 IEEE Conference on Computer Vision and Pattern Recognition. Columbus, OH, USA: IEEE: 580-587
  8. 8.
    Girshick R. 2015. Fast R-CNN//Proceedings of the IEEE International Conference on Computer Vision. Santiago, Chile: IEEE
  9. 9.
    He K M, Gkioxari G, Dollár P and Girshick R. 2017. Mask R-CNN//Proceedings of 2017 IEEE International Conference on Computer Vision. Venice, Italy: IEEE
  10. 10.
    He K M, Zhang X Y, Ren S Q and Sun J. 2016. Deep residual learning for image recognition//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Las Vegas, NV, USA: IEEE: 770-778
  11. 11.
    Hinton G E and Salakhutdinov R R. 2006. Reducing the dimensionality of data with neural networks. Science, 313(5786): 504-507
  12. 12.
    Kong T, Sun F C, Yao A B, Liu H P, Lu M and Chen Y R. 2017. RON: reverse connection with objectness prior networks for object detection//Proceedings of 2017 IEEE Conference on Computer Vision and Pattern Recognition. Honolulu, HI, USA: IEEE
  13. 13.
    LeCun Y, Bengio Y and Hinton G. 2015. Deep learning. Nature, 521(7553): 436-444
  14. 14.
    Lin H N, Shi Z W and Zou Z X. 2017c. Fully convolutional network with task partitioning for inshore ship detection in optical remote sensing images. IEEE Geoscience and Remote Sensing Letters, 14(10): 1665-1669
  15. 15.
    Lin T Y, Dollár P, Girshick R, He K M, Hariharan B and Belongie S. 2017a. Feature pyramid networks for object detection//Proceedings of 2017 IEEE Conference on Computer Vision and Pattern Recognition. Honolulu, HI, USA: IEEE
  16. 16.
    Lin T Y, Goyal P, Girshick R, He K M and Dollár P. 2017b. Focal loss for dense object detection//Proceedings of 2017 IEEE International Conference on Computer Vision. Venice, Italy: IEEE
  17. 17.
    Liu W, Anguelov D, Erhan D, Szegedy C, Reed S, Fu C Y and Berg A C. 2016. SSD: single shot multibox detector//Proceedings of the 14th European Conference on Computer Vision. Amsterdam, The Netherlands: Springer
  18. 18.
    Lure F Y M and Rau Y C. 1994. Detection of ship tracks in AVHRR cloud imagery with neural networks//Proceedings of 1994 IEEE International Geoscience and Remote Sensing Symposium. Pasadena: IEEE: 1401-1403
  19. 19.
    Qi S X, Ma J, Lin J, Li Y S and Tian J W. 2015. Unsupervised ship detection based on saliency and S-HOG descriptor from optical satellite images. IEEE Geoscience and Remote Sensing Letters, 12(7): 1451-1455
  20. 20.
    Redmon J and Farhadi A. 2018. Yolov3: an incremental improvement. arXiv preprint arXiv: 1804.02767
  21. 21.
    Redmon J, and Farhadi A. 2017. YOLO9000: better, faster, stronger//Proceedings of 2017 IEEE Conference on Computer Vision and Pattern Recognition. Honolulu, HI, USA: IEEE
  22. 22.
    Ren S Q, He K M, Girshick R and Sun J. 2015. Faster R-CNN: towards real-time object detection with region proposal networks//Proceedings of the 28th International Conference on Neural Information Processing Systems. Montreal, Canada: MIT Press: 91-99
  23. 23.
    Suleymanova I, Balassa T, Tripathi S, Molnar C, Saarma M, Sidorova Y and Horvath P. 2018. A deep convolutional neural network approach for astrocyte detection. Scientific Reports, 8: 12878
  24. 24.
    Tian S R, Sun G Y, Wang C and Zhang H. 2007. A Ship detection method in SAR image based on gravity enhancement. Journey of Remote Sensing. 11(4): 452-459
  25. 25.
    Wang H, Wang Q L, Gao M Q, Li P H and Zuo W M. 2018. Multi-scale location-aware kernel representation for object detection//Proceedings of 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Salt Lake City, UT, USA: IEEE
  26. 26.
    Wang F, Jiang M, Qian C, et al. Residual attention network for image classification[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2017: 3156-3164.
  27. 27.
    Yang G, Li B, Ji S F, Gao F and Xu Q Z. 2014. Ship detection from optical satellite images based on sea surface analysis. IEEE Geoscience and Remote Sensing Letters, 11(3): 641-645 .

Lire l'article complet

The above content is generated by Large Model Translation. The translated content is for reference only. We do not assume any commercial or legal responsibilty for any consequences arising from the use of our website