Anterior|Siguiente

Ship detection in remote sensing image based on dense RFB and LSTM

  • role： First author第一作者
  • Affiliation：

    College of Missile Engineering, Rocket Force University of Engineer, Xi'an 710025, China

  • Email：sunshinetaoz@163.com
  • Introduction：张涛，研究方向为遥感图像处理、目标检测等理论和应用。E-mail：sunshinetaoz@163.com
ZHANG Tao1,  
  • Affiliation：

    College of Missile Engineering, Rocket Force University of Engineer, Xi'an 710025, China

YANG Xiaogang1,  
  • Affiliation：

    Xi'an Institute of Optics and Precision Mechanics, Chinese Academy of Sciences, Xi'an 710068, China

LU Xiaoqiang2,  
  • Affiliation：

    College of Missile Engineering, Rocket Force University of Engineer, Xi'an 710025, China

LU Ruitao1,  
  • Affiliation：

    College of Missile Engineering, Rocket Force University of Engineer, Xi'an 710025, China

ZHANG Shengxiu1

resumen

Ship detection plays a crucial role in various applications and has drawn increasing attention in recent years. Deep learning methods based on CNNs, particularly SSD, have greatly improved detection performance due to their highly efficient feature extraction capability. However, SSD still has two problems. For instance, the detection network of arbitrarily arranged ship targets lacks a connection between high and low-level features and ignores contextual semantic information. Another problem is that natural factors such as light and clouds affect remote sensing images, thus ship detection may cause an imbalance of positive and negative samples.Aiming at solving the above issues, this paper proposes to achieve ship detection in remote sensing images by using a method based on Dense RFB and LSTM. This proposed method includes three elements. First, to enhance the detail feature extraction capability, this proposed method introduces a shallow feature enhancement module. This module draws on the idea of the human viewpoint, which uses Dense RFB feature reuse and expansion convolution to increase the receptive field. Second, to effectively extract deep semantic information and enhance the expressive ability of the network feature layer, a deep multi-scale feature pyramid fusion module (MFPF) is designed, as this proposed method draws on FPN and LSTM deconvolution and residual structure fuse deep multi-scale features. Finally, to solve the imbalance of positive and negative samples, the focal classification loss function is added, improving the accuracy of ship detection during training.The experiments were carried out on an optical remote sensing image dataset, in which only the ship dataset was used for training, validation, and testing. Results indicate that the proposed algorithm achieved an Average Precision (AP) of 81.98% and the detection speed reached 29.6 fps for ship targets, in which most ships were detected successfully. Moreover, for blurred, occluded, and partially-cropped ship targets, the algorithm’s detection effect is better than the traditional algorithm. Qualitative and quantitative results indicate that the generalization capability of the proposed method enhances ship detection.From this paper, we can draw three conclusions: (1) The proposed method can improve the extraction of detailed features and increase the receptive fields. (2) The focal loss function method shows good generalization capability. (3) The rotating box detection method is suitable for multi-scale and densely-arranged remote sensing images.

palabra clave

ship target detection;Dense RFB;feature pyramid networks;LSTM;multi-scale feature

References

  1. 1.
    Cao G M, Xie X M, Yang W Z, Liao Q, Shi G M and Wu J J. 2018. Feature-fused SSD: fast detection for small objects//Proceedings of SPIE 10615, Ninth International Conference on Graphic and Image Processing. Qingdao: SPIE: 106151E
  2. 2.
    Dong C. 2020. Research on the Detection of Ship Targets on the Sea Surface in Optical Remote Sensing Image. Changchun: Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Science, China (董超. 2020. 可见光遥感图像海面舰船目标检测技术研究. 长春: 中国科学院大学(中国科学院长春光学精密机械与物理研究所)
  3. 3.
    Guo W. 2019. Automatic Ship Detection in Optical Remote Sensing Images Based on Deep Learning. Wuhan: Wuhan University: 15-20
  4. 4.
    He K M, Zhang X Y, Ren S Q and Sun J. 2016. Deep residual learning for image recognition//Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition. Las Vegas: IEEE: 770-778.
  5. 5.
    Krizhevsky A, Sutskever I and Hinton G E. 2017. ImageNet classification with deep convolutional neural networks. Communications of the ACM, 60(6): 84-90.
  6. 6.
    Li H H, Zhou K P and Han T C. 2020. Ship object detection based on SSD improved with CReLU and FPN. Chinese Journal of Scientific Instrument, 41(4): 183-190
  7. 7.
    Lin T Y, Dollár P, Girshick R, He K M, Hariharan B, Belongie S. 2017. Feature pyramid networks for object detection//2017 IEEE Conference on Computer Vision and Pattern Recognition. Honolulu: IEEE: 936-944.
  8. 8.
    Lin T Y, Goyal P, Girshick R, He K M and Dollár P. 2020. Focal loss for dense object detection. IEEE Transactions on Pattern Analysis and Machine Intelligence, 42(2): 318-327.
  9. 9.
    Liu S T, Huang D and Wang Y H. 2018. Receptive field block net for accurate and fast object detection//15th European Conference on Computer Vision. Munich: Springer: 385-400.
  10. 10.
    Liu W, Anguelov D, Erhan D, Szegedy C, Reed S, Fu C Y and Berg A C. 2016. SSD: single shot MultiBox detector//14th European Conference on Computer Vision. Amsterdam: Springer: 21-27
  11. 11.
    Luo H L and Chen H K. 2020. Survey of object detection based on deep learning. Acta Electronica Sinica, 48(6): 1230-1239
  12. 12.
    Ma J, Shi W X, Bao S L. 2019. Ship target detection in remote sensing images based on feature fusion SSD. Journal of Computer Applications, 39(S2): 253-256
  13. 13.
    Redmon J, Divvala S, Girshick R and Farhadi A. 2016. You only look once: unified, real-time object detection//2016 IEEE Conference on Computer Vision and Pattern Recognition. Las Vegas: IEEE: 779-788.
  14. 14.
    Ren S Q, He K M, Girshick R and Sun J. 2017. Faster R-CNN: towards real-time object detection with region proposal networks. IEEE Transactions on Pattern Analysis and Machine Intelligence, 39(6): 1137-1149.
  15. 15.
    Shi W X, Jiang J H and Bao S L. 2020a. Ship detection method in remote sensing image based on feature fusion. Acta Photonica Sinica, 49(7): 57-67
  16. 16.
    Shi W X, Tan D L and Bao S L. 2020b. Feature enhancement SSD algorithm and its application in remote sensing images target detection. Acta Photonica Sinica, 49(1): 154-163
  17. 17.
    Wang L W, Feng Y Q and Zhang M B. 2019. Target detection method for optical remote sensing imagery. Systems Engineering and Electronics, 41(10): 2163-2169
  18. 18.
    Wang X K, Jiang H X and Lin K Y. 2020. Remote sensing image ship detection based on modified YOLO algorithm. Journal of Beijing University of Aeronautics and Astronautics, 46(6): 1184-1191
  19. 19.
    Xie X L, Li C X, Yang X G, Xi J X and Chen T. 2020. Dynamic receptive field-based object detection in aerial imaging. Acta Optica Sinica, 40(4): 107-119
  20. 20.
    Yu Y, Ai H, He X J, Yu S H, Zhong X and Zhu R F. 2020. Attention-based feature pyramid networks for ship detection of optical remote sensing image. Journal of Remote Sensing, 24(2): 107-115
  21. 21.
    Zeiler M D and Fergus R. 2014. Visualizing and understanding convolutional networks//Proceedings of the 13th 2014 European Conference on Computer Vision. Zurich: Springer: 818-833.
  22. 22.
    Zhang C G, Xiong B L, Kuang G Y. 2020. A survey of ship detection in optical satellite remote sensing images. Chinese Journal of Radio Science, 35(5): 637-647
  23. 23.
    Zhang M T. 2019. The Research on Small Object Detection Algorithm in Aerial Images Based on Depth Neural Network. Xi’an: Xidian University
  24. 24.
    Zhang W and Wei J J. 2020. Improved YOLO v3 fire detection algorithm embedded in DenseNet structure and dilated convolution module. Journal of Tianjin University (Science and Technology), 53(9): 976-983
  25. 25.
    Zhou H, Guo J, Zhu C R and Wang R S. 2010. Ship detection from optical remote sensing images based on PLSA model. Journal of Remote Sensing, 14(4): 663-680
  26. 26.
    Zhu L Y, Xiong G, Guo D M and Yu W X. 2019. Ship target detection and segmentation method based on multi-fractal analysis. The Journal of Engineering, (21): 7876-7879.
  27. 27.
    Zhu M. 2004. Recall, precision and average precision. Department of Statisticsand Actuarial Science, University of Waterloo, Waterloo 2 (2004) 30.32.
  28. 28.
    Zhu Y, Fang G S, Zheng B B and Han F. 2020. Research on detection method of refined rotated boxes in remote sensing. Acta Photonica Sinica, 45(1): 1-11
  29. 29.
    Zou Z, Shi Z. 2017. Random access memories: A new paradigm for target detection in high resolution aerial remote sensing images. IEEE Transactions on Image Processing, 2017, 27(3): 1100-1111.

Leer el texto completo

The above content is generated by Large Model Translation. The translated content is for reference only. We do not assume any commercial or legal responsibilty for any consequences arising from the use of our website