سابِق|تال

Remote sensing image detection method based on brain-inspired spiking neural networks

  • role： First author第一作者
  • Affiliation：

    School of Electronic Information and Electrical Engineering, Shanghai Jiao Tong University, Shanghai 200240, China

  • Email：jumpywizard@sjtu.edu.cn
  • Introduction：段德鑫，研究方向为人工智能、神经形态计算。E-mail： jumpywizard@sjtu.edu.cn
DUAN Dexin1,  
  • Affiliation：

    Beijing Institute of Remote Sensing Information, Beijing 100192, China

LU Yao2,  
  • Affiliation：

    Beijing Institute of Remote Sensing Information, Beijing 100192, China

HUANG Liwei2,  
  • Affiliation：

    School of Electronic Information and Electrical Engineering, Shanghai Jiao Tong University, Shanghai 200240, China

LIU Peilin1,  
  • role： Corresponding author通信作者
  • Affiliation：

    School of Electronic Information and Electrical Engineering, Shanghai Jiao Tong University, Shanghai 200240, China

  • Email：wenfei@sjtu.edu.cn
  • Introduction：文飞，研究方向为类脑计算、机器学习、信号/图像处理。E-mail： wenfei@sjtu.edu.cn
WEN Fei1*

ملخص

In the intelligent processing of remote sensing images, third-generation brain-inspired Spiking Neural Network (SNN) surpasses its predecessor, the second-generation artificial neural network, showing remarkable advantages in terms of high energy efficiency, high precision, and high interpretability. These advantages stem from the SNN’s characteristic features, including high energy efficiency, elevated sparsity, and remarkable bio-plausibility. The integration of these features in the SNN presents an enthralling solution to challenges faced in remote sensing image processing and holds immense potential for advancing this field further.The proposed algorithm introduces a novel approach and initially establishes a target-detection neural network, which serves as the source artificial neural network for pretraining. This source network utilizes a dynamic clipping threshold activation function to optimize its performance. Subsequently, the algorithm transforms the source network into a brain-inspired SNN by leveraging the mapping relationship between activated neurons and spiking neurons. This conversion process effectively incorporates the clipping thresholds obtained during training. By seamlessly transitioning the source network into an SNN, the algorithm ensures the preservation and enhancement of key characteristics essential for remote sensing image processing.The integration of the third-generation brain-inspired SNN into remote sensing image processing holds tremendous potential primarily due to its high precision and low energy consumption. The proposed algorithm highlights the distinctive attributes of the SNN, such as its low delay, high bionics, and ability to inherit high precision observed in a source network. These characteristics are promising indicators of SNN’s capability to considerably enhance the intelligent processing of remote sensing images. By leveraging the SNN’s high precision and bio-plausible principles, the proposed algorithm lays a robust foundation for future advancements in the field of remote sensing. The SNN’s inclusion in the image processing pipeline causes a paradigm shift, challenging traditional assumptions and unlocking new possibilities. The SNN is highly accurate in identifying and classifying targets with remarkable precision during remote sensing target detection. In conclusion, the proposed algorithm exhibits low delay and high bionics while demonstrating the high precision of a source network, demonstrating its potential to considerably improve the intelligent processing of remote sensing images and offering high accuracy, precision, interpretability; low energy consumption; and high bio-plausibility.The efficacy of the proposed method was evaluated through extensive experiments performed on two widely recognized open remote sensing datasetsSAR-Ship-Detection-Datasets (SSDD) and RSOD. Experimental results highlighted the exceptional capabilities of the proposed method in transforming the source network into a brain-inspired spiking neural network, demonstrating negligible loss in performance. Furthermore, the transformed SNN exhibited remarkable accuracy in detecting and recognizing remote sensing targets within significantly reduced time steps. The performance achieved by the transformed SNN was comparable to that of the source artificial neural network while tremendously reducing power consumption by over two orders of magnitudes. This outcome highlights the immense potential of the proposed method in revolutionizing the field of remote sensing image processing by delivering high precision and interpretability which considerably reducing energy consumption.

مفهوم

SAR;remote sensing image;optical remote sensing;target detection;deep learning;spiking neural networks

References

  1. 1.
    An R, Gong P, Wang H L, Feng X Z, Xiao P F, Chen Q, Zhang Q, Chen C Y and Yan P. 2010. A modified PSO algorithm for remote sensing image template matching. Photogrammetric Engineering and Remote Sensing, 76(4): 379-389
  2. 2.
    Carion N, Massa F, Synnaeve G, Usunier N, Kirillov A and Zagoruyko S. 2020. End-to-end object detection with transformers//16th European Conference on Computer Vision. Glasgow: Springer: 213-229
  3. 3.
    Che K W, Leng L, Zhang K X, Zhang J G, Meng M Q H, Cheng J, Guo Q H and Liao J X. 2022. Differentiable hierarchical and surrogate gradient search for spiking neural networks//Proceedings of the 36th International Conference on Neural Information Processing Systems. New Orleans: Curran Associates Inc.: 24975-24990
  4. 4.
    Chen Y L, Qin R J, Zhang G X and Albanwan H. 2021. Spatial temporal analysis of traffic patterns during the COVID-19 epidemic by vehicle detection using planet remote-sensing satellite images. Remote Sensing, 13(2): 208
  5. 5.
    El Shair I M. 2003. GIS and remote sensing in urban transportation planning: a case study of Birkenhead, Auckland//6th Annual International Conference. 28-31
  6. 6.
    Gao J F, Chen Y, Wei Y M and Li J N. 2021. Detection of specific building in remote sensing images using a novel YOLO-S-CIOU model. Case: gas station identification. Sensors, 21(4): 1375
  7. 7.
    Ghosh-Dastidar S and Adeli H. 2009. Spiking neural networks. International Journal of Neural Systems, 19(4): 295-308
  8. 8.
    Girshick R. 2015. Fast R-CNN//2015 IEEE International Conference on Computer Vision. Santiago: IEEE: 1440-1448
  9. 9.
    Horowitz M. 2014. 1.1 computing’s energy problem (and what we can do about it)//2014 IEEE International Solid-State Circuits Conference Digest of Technical Papers (ISSCC). San Francisco: IEEE: 10-14
  10. 10.
    Kheradpisheh S R, Ganjtabesh M, Thorpe S J and Masquelier T. 2018. STDP-based spiking deep convolutional neural networks for object recognition. Neural Networks, 99: 56-67
  11. 11.
    Li D R, Ding L and Shao Z F. 2021. Application-oriented real-time remote sensing service technology. National Remote Sensing Bulletin, 25(1): 15-24
  12. 12.
    Liu S C, Du K C, Zheng Y J, Chen J, Du P J and Tong X H. 2023. Remote sensing change detection technology in the era of artificial intelligence: inheritance, development and challenges. National Remote Sensing Bulletin, 27(9): 1975-1987
  13. 13.
    Niu L Y, Wei Y and Liu Y. 2023. Event-driven spiking neural network based on membrane potential modulation for remote sensing image classification. Engineering Applications of Artificial Intelligence, 123: 106322
  14. 14.
    Pham M T, Courtrai L, Friguet C, Lefèvre S and Baussard A. 2020. YOLO-Fine: one-stage detector of small objects under various backgrounds in remote sensing images. Remote Sensing, 12(15): 2501
  15. 15.
    Redmon J, Divvala S, Girshick R and Farhadi A. 2016. You only look once: unified, real-time object detection//2016 IEEE Conference on Computer Vision and Pattern Recognition. Las Vegas: IEEE: 779-788
  16. 16.
    Redmon J and Farhadi A. 2018. Yolov3: an incremental improvement. arXiv preprint arXiv:1804.02767
  17. 17.
    Rueckauer B, Lungu I A, Hu Y H, Pfeiffer M and Liu S C. 2017. Conversion of continuous-valued deep networks to efficient event-driven networks for image classification. Frontiers in Neuroscience, 11: 682
  18. 18.
    Sha M M, Li Y and Li A. 2022. Multiscale aircraft detection in optical remote sensing imagery based on advanced Faster R-CNN. National Remote Sensing Bulletin, 26(8): 1624-1635
  19. 19.
    Tavanaei A, Ghodrati M, Kheradpisheh S R, Masquelier T and Maida A. 2019. Deep learning in spiking neural networks. Neural Networks, 111: 47-63
  20. 20.
    Xu Z Y, Shen Z F, Li Y, Li J L, Wang H Y, Li S, Jiao S H and Li L L. 2022. Detection of water conservancy facilities in large-format image combining E-YOLO algorithm and NDWI constraint. National Remote Sensing Bulletin, 26(10): 2083-2093
  21. 21.
    Zhang S M, Wu R Z, Xu K Y, Wang J M and Sun W W. 2019. R-CNN-based ship detection from high resolution remote sensing imagery. Remote Sensing, 11(6): 631
  22. 22.
    Zhang Y P, Bi D P, Zhou Y, Zhang B and Fang M X. 2019. Effect of cosinusoidal phase-modulated scatter-wave jamming to the jamming suppression of SAR dual-channel cancellation. Journal of Remote Sensing (in Chinese), 23(1): 99-107
  23. 23.
    Zhu X X, Montazeri S, Ali M, Hua Y S, Wang Y Y, Mou L C, Shi Y L, Xu F and Bamler R. 2021. Deep learning meets SAR: concepts, models, pitfalls, and perspectives. IEEE Geoscience and Remote Sensing Magazine, 9(4): 143-172

قراءة النص الكامل

The above content is generated by Large Model Translation. The translated content is for reference only. We do not assume any commercial or legal responsibilty for any consequences arising from the use of our website