سابِق|تال

Daytime sea fog detection based on multi-scale feature fusion of generated adversarial network under attention mechanism

  • role： First author第一作者
  • Affiliation：

    Faculty of Electrical Engineering and Computer Science, Ningbo University, Ningbo 315211, China

  • Email：fangxuyuan1130@163.com
  • Introduction：方旭源，研究方向为海雾监测、深度学习。E-mail： fangxuyuan1130@163.com
FANG Xuyuan1,  
  • role： Corresponding author通信作者
  • Affiliation：

    Faculty of Electrical Engineering and Computer Science, Ningbo University, Ningbo 315211, China

  • Email：xyjw1969@126.com
  • Introduction：金炜，研究方向为遥感图像处理、医学影像处理。E-mail： xyjw1969@126.com
JIN Wei1*,  
  • Affiliation：

    Faculty of Electrical Engineering and Computer Science, Ningbo University, Ningbo 315211, China

FU Randi1,  
  • Affiliation：

    Faculty of Electrical Engineering and Computer Science, Ningbo University, Ningbo 315211, China

LI Gang1,  
  • Affiliation：

    Zhenhai District Meteorological Bureau, Ningbo 315202, China

HE Caifen2,  
  • Affiliation：

    Faculty of Electrical Engineering and Computer Science, Ningbo University, Ningbo 315211, China

YI Caoqian1

ملخص

Sea fog is a common weather phenomenon at sea. It will reduce visibility at sea and greatly threaten maritime traffic and other operations. Traditional sea fog detection algorithms using satellite remote sensing have low accuracy, poor portability, and low automation. Although some existing deep learning-based sea fog monitoring algorithms have been improved, they do not consider the spectral characteristics of sea fog in different channels. The accuracy of sea fog monitoring is also low, especially in edge recognition.A daytime sea fog detection method, which is based on multi-scale feature fusion of generated adversarial network under attention mechanism, is proposed to improve the accuracy of sea fog detection. First, according to the spectral response of sea fog in different imaging channels of meteorological satellite, the satellite cloud images of different imaging channels that can reflect the characteristics of sea fog are selected as the input of the network. Meanwhile, a channel attention mechanism is introduced to calculate the weights of different input channels for prioritizing significant imaging channels within multichannel input. Then, a multi-scale feature fusion mechanism is adopted to fuse the feature maps of different levels of the network for obtaining the multi-scale features of the sea fog. In this way, the problem of losing detailed features in cloud images caused by the pooling operation of the traditional deep network can be solved. Finally, given the difficulty of traditional methods to accurately describe the edge of sea fog, a generation network for sea fog detection supervised by an adversarial network is used to accurately define the edge of sea fog and reduce the false alarm rate.This study takes the Yellow Sea and the Bohai Sea (116.5°—128.25°E，30°—42.5°N) as the research area. Given that March to June each year is the period of high incidence of sea fog in the Yellow Sea and the Bohai Sea, we produce a dataset based on the weather satellite monitoring report of the National Meteorological Center from March to June 2017—2020. After training the model, concerning the quantitative indicators of sea fog detection, our method achieves a probability of detection of 90.5%, a critical success index of 81.28%, and a false positive rate of 10.86%, which are better than those of other methods.The experimental results show that the proposed method can effectively improve the accuracy of sea fog identification, which is important for marine vessel navigation, fishery production, national defense, and military affairs.

مفهوم

Sea fog monitoring;satellite remote sensing;attention mechanism;Generate adversarial network;Multi-scale feature fusion

References

  1. 1.
    Bendix J, Thies B, Cermak J and Nauß T. 2005. Ground fog detection from space based on MODIS daytime data—a feasibility study. Weather and Forecasting, 20(6): 989-1005
  2. 2.
    Cermak J and Bendix J. 2008. A novel approach to fog/low stratus detection using Meteosat 8 data. Atmospheric Research, 87(3/4): 279-292
  3. 3.
    Chen L. 2006. Studies on EOS/MODIS Data Processing and an Application on Monitoring Fog/Low Stratus by Daylight. Nanjing: Nanjing University of Information Science and Technology
  4. 4.
    Deng Y J, Wang J C and Cao J. 2013. Detection of daytime fog in South China Sea using MODIS data. Journal of Tropical Meteorology, 29(6): 1046-1050
  5. 5.
    Eyre J R, Brownscombe J L and Allam R J. 1984. Detection of fog at night using advanced very high resolution radiometer (AVHRR) imagery. Meteorological Magazine, 113(1346): 266-271
  6. 6.
    Goodfellow I J, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D, Ozair S, Courville A and Bengio Y. 2014. Generative adversarial nets//Proceedings of the 27th International Conference on Neural Information Processing Systems. Montreal: MIT Press: 2672-2680
  7. 7.
    Huang H M, Lin L F, Tong R F, Hu H J, Zhang Q W, Iwamoto Y, Han X H, Chen Y W and Wu J. 2020. UNet 3+: a full-scale connected UNet for medical image segmentation//2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). Barcelona: IEEE: 1055-1059
  8. 8.
    Hunt G E. 1973. Radiative properties of terrestrial clouds at visible and infra-red thermal window wavelengths. Quarterly Journal of the Royal Meteorological Society, 99(420): 346-369
  9. 9.
    Ishida H, Miura K, Matsuda T, Ogawara K, Goto A, Matsuura K, Sato Y and Nakajima T Y. 2014. Scheme for detection of low clouds from geostationary weather satellite imagery. Atmospheric Research, 143: 250-264
  10. 10.
    Li Y C, Sun H, Li X G, Tang Y and Xu M. 2001. Study on detection of daytime fog using GMS-5 weather satellite data. Journal of Nanjing Institute of Meteorology, 24(3): 343-349
  11. 11.
    Lin T Y, Goyal P, Girshick R, He K M and Dollar P. 2020. Focal loss for dense object detection. IEEE Transactions on Pattern Analysis and Machine Intelligence, 42(2): 318-327
  12. 12.
    Liu S X, Yi L, Zhang S P, Shi X M and Xue Y C. 2019. A study of daytime sea fog retrieval over the yellow sea based on fully convolutional networks. Transactions of Oceanology and Limnology, 41(6): 13-22
  13. 13.
    Liu Y J. 2019. Research on Image Semantic Segmentation Method Based on Generative Adversarial Network. Beijing: Beijing Jiaotong University
  14. 14.
    Máttyus G, Luo W J and Urtasun R. 2017. DeepRoadMapper: extracting road topology from aerial images//2017 IEEE International Conference on Computer Vision (ICCV). Venice: IEEE: 3458-3466
  15. 15.
    Pavolonis M. 2010. GOES-R Advanced Baseline Imager (ABI) Algorithm Theoretical Basis Document for Volcanic Ash
  16. 16.
    Ronneberger O, Fischer P and Brox T. 2015. U-Net: convolutional networks for biomedical image segmentation//18th International Conference on Medical Image Computing and Computer-Assisted Intervention. Munich: Springer: 234-241
  17. 17.
    Si G, Fu R D, He C F and Jin W. 2020. Daytime sea fog recognition based on remote sensing satellite and deep neural network. Journal of Optoelectronics·Laser, 31(10): 1074-1082
  18. 18.
    Su J. 2001. A review of circulation dynamics of the coastal oceans near China. Acta Oceanologica Sinica, 23(4): 1-16
  19. 19.
    Tian L, Wang X, Yang B Y and Wu X J. 2021. Overview of satellite remote sensing technology for marine atmospheric and environment observation. Science and Technology Review, 39(15): 54-66
  20. 20.
    Tian Y J. 2016. Study of Algorithm of Detection of Daytime Sea Fog using FY-2 Geostationary Satellite Data. Guangzhou: South China University of Technology
  21. 21.
    Wang B H. 1983. Sea Fog. Ocean Press
  22. 22.
    Wang Z, Simoncelli E P and Bovik A C. 2003. Multiscale structural similarity for image quality assessment//The Thirty-Seventh Asilomar Conference on Signals, Systems and Computers. Pacific Grove: IEEE: 1398-1402
  23. 23.
    Xiao Y F, Zhang J, Cui T W and Qin P. 2017. Review of sea fog detection from satellite remote sensing data. Marine Sciences, 41(12): 146-154
  24. 24.
    Zhang C G, Cai Y Y and Zhang J C. 2009. The application of monitoring sea fog in Taiwan strait using MODIS remote sensing data. Journal of Applied Meteorological Science, 20(1): 8-16
  25. 25.
    Zhang P and Wu D. 2019. Daytime sea fog detection method using Himawari-8 data. Journal of Atmospheric and Environmental Optics, 14(3): 211-220

قراءة النص الكامل

The above content is generated by Large Model Translation. The translated content is for reference only. We do not assume any commercial or legal responsibilty for any consequences arising from the use of our website