سابِق|تال

Dual-threshold registration based on surface fitting of aerial filter array multispectral images

  • role： First author第一作者
  • Affiliation：

    College of Aviation Combat Service, Air Force Aviation University, Changchun 130022, China

  • Email：2423688595@qq.com
  • Introduction：李铜哨， 研究方向为数字图像处理。E-mail： 2423688595@qq.com
LI Tongshao,  
  • role： Corresponding author通信作者
  • Affiliation：

    College of Aviation Combat Service, Air Force Aviation University, Changchun 130022, China

  • Email：chwenbang@163.com
  • Introduction：孙文邦，研究方向为数字图像处理、信息保障理论。E-mail： chwenbang@163.com
SUN Wenbang*,  
  • Affiliation：

    College of Aviation Combat Service, Air Force Aviation University, Changchun 130022, China

YUE Guang,  
  • Affiliation：

    College of Aviation Combat Service, Air Force Aviation University, Changchun 130022, China

GU Zilyu

ملخص

Aerial filter array multispectral images and their high precision registrations are important for guaranteeing subsequent image processing and application. In the process of image registration, the position accuracy of matching points is important in determining the accuracy of image registration. However, objects of different strips in the same band image are acquired at different moments, the image displacement between single-band images is large, and the difference in geometric errors of matching points between topographic undulating areas and flat areas in the image is obvious. Additionally, false matching points cannot be accurately eliminated by the global matrix. The difficulty of eliminating mismatched points in multispectral images of aerial filter arrays must be addressed because of the displacement of image points between spectral segments. Thus, a new method of double-threshold elimination based on matching point position difference surface fitting is proposed in this study.First, the intermediate band image of the filter array multispectral images was selected as the reference image, and the matching points in the reference image and the image to be registered were extracted by the subpixel-level SIFT algorithm. Second, the difference in the positions of the matching points of the two bands was calculated point by point at the matching points of the benchmark image, and the Delaunay triangulation network of matching points in the reference image was constructed. The position difference surface was smoothed, the position differences between the matching points of the reference image and the corresponding matching points of the image requiring registration were calculated point by point, and a certain tolerance range was shifted upward and downward to form a 3D position difference threshold space. Finally, accurate matching points were selected using the 3D threshold space of the position difference to complete the registration.The three-band composite image of the algorithm-registered image in this study presented clear features and well-defined details and met the requirements of subsequent data processing and application. The effectiveness of the proposed algorithm was illustrated by registering two datasets of filter array multispectral images, from which qualitative and quantitative perspectives were verified. Regarding false color, the composite image processed by the proposed algorithm did not show obvious pseudoedges, and the features were clear. However, pseudoedges were obvious in the comparison algorithm and difference image grayscale histograms. Among the experiments of the two datasets, the difference image histogram curve of the proposed algorithm presented the largest shift to the left. The image registered by the proposed algorithm had the smallest difference from the reference image and the best registration effect.Theoretical analysis and experimental results show that the dual-threshold pointing algorithm based on matching point difference fitting of curved surfaces can screen high-precision matching points in aerial filter array multispectral images and effectively improve the accuracy of image registration. Surface fitting to the position difference of matching points can help reveal the trend of image point displacement in each region. This scheme can also effectively eliminate false matching points around the correct matching points, especially since the image displace.

مفهوم

remote sensing;Curved surface;fitting Double threshold;Filter array;multispectral image;registration

References

  1. 1.
    Chen C F and Li Y Y. 2019. A fast global interpolation method for digital terrain model generation from large LiDAR-derived data. Remote Sensing, 11(11): 1324
  2. 2.
    Feng R T, Li X H, Zou W L and Shen H F. 2017. Registration of multitemporal GF-1 remote sensing images with weighting perspective transformation model//2017 IEEE International Conference on Image Processing. Beijing: IEEE
  3. 3.
    Fischler M A and Bolles R C. 1981. Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Communications of the ACM, 24(6): 381-395
  4. 4.
    Gong Z C, Pei J H and Xie W X. 2013. Research of accurate registration method for multispectral remote sensing images. Journal of Signal Processing, 29(10): 1398-1406
  5. 5.
    Huang Y, Lan Y and Hoffmann W C. 2008. Use of airborne multi-spectral imagery in pest management systems. Agricultural Engineering International: CIGR Journal
  6. 6.
    Li F F, Xiao B L, Jia Y H and Mao X L. 2009. Improved SIFT algorithm and its application in automatic registration of remotely-sensed imagery. Geomatics and Information Science of Wuhan University, 34(10): 1245-1249
  7. 7.
    Li Q Q, Han G L, Liu P X, Yang H, Luo H Y and Wu J J. 2021. An infrared-visible image registration method based on the constrained point feature. Sensors, 21(4): 1188
  8. 8.
    Liang J X, Wan X X and Liu Q. 2015. Research on visible broadband spectral image registration method based on SIFT algorithm. Journal of Hunan University of Technology, 29(2): 57-63, 93
  9. 9.
    Meng J J, Wu J Q, Lu L L, Li Q T, Zhang Q, Feng S Y and Yan J. 2020. A full-spectrum registration method for Zhuhai-1 satellite hyperspectral imagery. Sensors, 20(21): 6298
  10. 10.
    Paul S and Pati U C. 2021. A comprehensive review on remote sensing image registration. International Journal of Remote Sensing, 42(14): 5400-5436
  11. 11.
    Shao C Y, Zhang C, Fang Z J and Yang G L. 2020. A deep learning-based semantic filter for RANSAC-based fundamental matrix calculation and the ORB-SLAM system. IEEE Access, 8: 3212-3223
  12. 12.
    Tang Z J, Ma G Q, Lu J Q, Wang Z, Fu B and Wang Y J. 2020. Sonar image mosaic based on a new feature matching method. IET Image Processing, 14(10): 2149-2155
  13. 13.
    Vakalopoulou M and Karantzalos K. 2014. Automatic descriptor-based co-registration of frame hyperspectral data. Remote Sensing, 6(4): 3409-3426
  14. 14.
    Wang G, Li J N, Su Q T, Zhang X F, Lü G H and Wang H G. 2017. Algorithm based on morphological component analysis and scale-invariant feature transform for image registration. Journal of Shanghai Jiaotong University (Science), 22(1): 99-106
  15. 15.
    Wang J J, Shi Y and Liu H H. 2017. Registration of frame hyperspectral images based on UAV. Chinese Journal of Agricultural Resources and Regional Planning, 38(9): 63-71
  16. 16.
    Wang Y and Gong Y. 2016. Design of multispectral imaging spectrometer using linear variable filter. Laser and Optoelectronics Progress, 53(1): 013003
  17. 17.
    Yang H, Li X R, Zhao L Y and Chen S H. 2019. A novel coarse-to-fine scheme for remote sensing image registration based on SIFT and phase correlation. Remote Sensing, 11(15): 1833
  18. 18.
    Zhang Z, Han D Q, Dezert J and Yang Y. 2019. A new image registration algorithm based on evidential reasoning. Sensors, 19(5): 1091
  19. 19.
    Zhao H R and Lu S H. 2018. Dense high-definition image matching strategy based on scale distribution of feature and geometric constraint. Acta Geodaetica et Cartographica Sinica, 47(6): 790-798
  20. 20.
    Zheng J, Xu Q Z, Zhai B and Wang Y. 2020. Accurate hyperspectral and infrared satellite image registration method using structured topological constraints. Infrared Physics and Technology, 104: 103122

قراءة النص الكامل

The above content is generated by Large Model Translation. The translated content is for reference only. We do not assume any commercial or legal responsibilty for any consequences arising from the use of our website