Aircraft target change detection for high-resolution remote sensing images using multi-feature fusion

  • role: First author第一作者
  • Affiliation:

    Information Engineering University, Institute of Geospatial Information, Zhengzhou 450001, China

  • Email:xjf4606@foxmail.com
  • Introduction:徐俊峰,1990生,男,博士研究生, 研究方向为遥感影像变化检测的理论和应用。E-mail: xjf4606@foxmail.com
XU Junfeng1,  
  • Affiliation:

    Information Engineering University, Institute of Geospatial Information, Zhengzhou 450001, China

ZHANG Baoming1,  
  • Affiliation:

    Information Engineering University, Institute of Geospatial Information, Zhengzhou 450001, China

YU Donghang1,  
  • Affiliation:

    Information Engineering University, Institute of Geospatial Information, Zhengzhou 450001, China

LIN Yuzhun1,  
  • Affiliation:

    Information Engineering University, Institute of Geospatial Information, Zhengzhou 450001, China

GUO Haitao1

реферат

Multi-feature fusion has been widely employed for high-resolution remote sensing images change detection given its ability to reduce the influence of radiation difference, projection errors, and shadows. However, most multi-feature fusion methods depend on artificially designed fusion rules or man-made samples. Meanwhile, many methods for target change detection on bi-temporal images have successfully detected the changed areas yet fail to recognize the number and location of changed targets. To address these limitations, this paper proposes an aircraft target change detection method for high-resolution remote sensing images that combines adaptive multi-feature fusion for change detection with deep learning for target recognition.First, Iteratively Reweighted Multivariate Alteration Detection (IR-MAD) is applied to generate a change intensity map, and then adaptive histogram statistics are employed to calculate the threshold for the automatic acquisition of conspicuous changed and unchanged samples. Second, the edge and textural features are extracted respectively from multi-temporal images, and a multi-feature fusion change detection is carried out by using a support vector machine and the previous samples. The change polygons are obtained after morphological processing. Third, to prevent a false detection by a single threshold, a multi-threshold strategy is adopted, and raw images from the change polygons are recognized by using the aircraft recognition model that is trained by a few plane slices and the convolutional neural network with network in network.The experiments for airport images change detection and final aircraft target change detection experiments are performed using two datasets. First, we compare our proposed method is compared with other thresholds and check whether to use multi-features should be used to highlight the effectiveness of our multi-feature fusion change detection method with adaptive samples. To verify its performance, we compare our method with some popular change detection methods are compared, including Multivariate Alteration Detection (MAD), IR-MAD, principal component analysis, change vector analysis, robust change vector analysis, and iterative slow feature analysis. The experiments show that the overall accuracy of our proposed change detection method outperforms the other compared methods in terms of accuracy and false alarm rate. We obtain our target change detection results based on the change map, and validate the excellent performance of our proposed method based on its accuracy.To fully use of the spectral, spatial, and textural features of high-resolution remote sensing images, we design an adaptive multi-feature fusion method for change detection that requires less manual work and reduces the influence of radiation difference, projection error, and shadows. We also propose an aircraft target change detection method by combining the multi-feature fusion change detection with target recognition using deep learning. The experimental results validate the excellent performance and reliability of our method.

ключеви́че слова́

remote sensing;change detection;multi-feature fusion;aircraft target;high-resolution remote sensing images;IR-MAD;convolutional neural network

References

  1. 1.
    Bovolo F and Bruzzone L. 2007. A theoretical framework for unsupervised change detection based on change vector analysis in the polar domain. IEEE Transactions on Geoscience and Remote Sensing, 45(1): 218-236
  2. 2.
    Celik T. 2009. Unsupervised change detection in satellite images using principal component analysis and k-means clustering. IEEE Geoscience and Remote Sensing Letters, 6(4): 772-776
  3. 3.
    Chen L Y, Yan M L, Sun X and Wang H Q. 2016. An automatic aircraft detection method based on background prior. Science of Surveying and Mapping, 41(3): 69-74, 33
  4. 4.
    Du P J and Liu S C. 2012. Change detection from multi-temporal remote sensing images by integrating multiple features. Journal of Remote Sensing, 16(4): 663-677
  5. 5.
    Ekblad U and Kinser J M. 2004. Theoretical foundation of the intersecting cortical model and its use for change detection of aircraft, cars, and nuclear explosion tests. Signal Processing, 84(7): 1131-1146
  6. 6.
    Hao R, Xu J F, Wang Q B and Zhang B M. 2016. Change detection method using multi-feature fusion based on BP neural network. Hydrographic Surveying and Charting, 36(1): 79-82
  7. 7.
    Hsieh J W, Chen J M, Chuang C H and Fan K C. 2005. Aircraft type recognition in satellite images. IEE Proceedings - Vision, Image and Signal Processing, 152(3): 307-315
  8. 8.
    Li L, Shu N, Wang K and Gong Y. 2014. Change detection method for remote sensing images based on multi-features fusion. Acta Geodaetica et Cartographica Sinica, 43(9): 945-953
  9. 9.
    Li X J, Wang C L, Li Y and Sun H. 2016. Optical remote sensing object detection based on fused feature contrast of subwindows. Optics and Precision Engineering, 24(8): 2067-2077
  10. 10.
    Lin M, Chen Q and Yan S C. 2013. Network in network. arXiv preprint arXiv:1301.3557
  11. 11.
    Liu W, Anguelov D, Erhan D, Szegedy C, Reed S, Fu C Y and Berg A C. 2016. SSD: single shot MultiBox detector//Proceedings of the 14th European Conference on Computer Vision. The Netherlands: Springer: 21-37
  12. 12.
    Maggiori E, Tarabalka Y, Charpiat G and Alliez P. 2017. Convolutional neural networks for large-scale remote-sensing image classification. IEEE Transactions on Geoscience and Remote Sensing, 55(2): 645-657
  13. 13.
    Nielsen A A, Conradsen K and Simpson J J. 1998. Multivariate Alteration Detection (MAD) and MAF postprocessing in multispectral, bitemporal image data: new approaches to change detection studies. Remote Sensing of Environment, 64(1): 1-19
  14. 14.
    Nielsen A A. 2007. The regularized iteratively reweighted MAD method for change detection in multi- and hyperspectral data. IEEE Transactions on Image Processing, 16(2): 463-478
  15. 15.
    Redmon J, Divvala S, Girshick R and Farhadi A. 2016. You only look once: unified, real-time object detection//Proceedings of 2016 IEEE Conference on Computer Vision and Pattern Recognition. Las Vegas, NV, USA: IEEE: 779-788
  16. 16.
    Ren S Q, He K M, Girshick R and Sun J. 2015. Faster R-CNN: towards real-time object detection with region proposal networks//Proceedings of the 28th International Conference on Neural Information Processing Systems. Montreal, Canada: ACM: 91-99
  17. 17.
    Sun H, Sun X, Wang H Q, Li Y and Li X J. 2012. Automatic target detection in high-resolution remote sensing images using spatial sparse coding Bag-of-Words model. IEEE Geoscience and Remote Sensing Letters, 9(1): 109-113
  18. 18.
    Thonfeld F, Feilhauer H, Braun M and Menz G. 2016. Robust Change Vector Analysis (RCVA) for multi-sensor very high resolution optical satellite data. International Journal of Applied Earth Observation and Geoinformation, 50: 131-140
  19. 19.
    Wang W S, Nie T, Fu T J, Ren J Y and Jin L X. 2017. A novel method of aircraft detection based on high-resolution panchromatic optical remote sensing images. Sensors, 17(5): 1047
  20. 20.
    Wu C, Du B and Zhang L P. 2014. Slow feature analysis for change detection in multispectral imagery. IEEE Transactions on Geoscience and Remote Sensing, 52(5): 2858-2874
  21. 21.
    Xiang S W, Wen G J and Gao F. 2016. Knowledge driven change detection method for aircraft targets. Remote Sensing for Land and Resources, 28(4): 77-82
  22. 22.
    Xiao P F, Zhang X L, Wang D G, Yan M, Feng X Z and Kelly M. 2016. Change detection of built-up land: a framework of combining pixel-based detection and object-based recognition. ISPRS Journal of Photogrammetry and Remote Sensing, 119: 402-414
  23. 23.
    Xu J F, Guo H T, Zhang R and Liu P C. 2015. An adaptive edge detection method for multi-spectral image combining quaternion and histogram. Journal of Geomatics Science and Technology, 32(1): 61-65
  24. 24.
    Zhang L P, Zhang L F and Du B. 2016. Deep learning for remote sensing data: a technical tutorial on the state of the art. IEEE Geoscience and Remote Sensing Magazine, 4(2): 22-40
  25. 25.
    Zhang X L, Chen X W, Li F and Yang T. 2017. Change detection method for high resolution remote sensing images using deep learning. Acta Geodaetica et Cartographica Sinica, 46(8): 999-1008
  26. 26.
    Zhao A, Fu K, Sun H, Sun X, Li F, Zhang D B and Wang H Q. 2017. An effective method based on ACF for aircraft detection in remote sensing images. IEEE Geoscience and Remote Sensing Letters, 14(5): 744-748
  27. 27.
    Zhao M and Zhao Y D. 2018. Object-oriented and multi-feature hierarchical change detection based on CVA for high-resolution remote sensing imagery. Journal of Remote Sensing, 22(1): 119-131

Читать полностью

The above content is generated by Large Model Translation. The translated content is for reference only. We do not assume any commercial or legal responsibilty for any consequences arising from the use of our website