Früher|Nächster

Automatic fast feature-level image registration for high-resolution remote sensing images

  • role： First author第一作者
  • Affiliation：

    Institute of Remote Sensing and Digital Earth, Chinese Academy of Sciences, Beijing 100094, China

    University of Chinese Academy of Sciences, Beijing 100049, China

  • Email：hemm@radi.ac.cn
  • Introduction：何梦梦(1990—　)，女，硕士研究生，研究方向为遥感图像处理。E-mail：hemm@radi.ac.cn
Mengmeng HE12,  
  • role： Corresponding author通信作者
  • Affiliation：

    Institute of Remote Sensing and Digital Earth, Chinese Academy of Sciences, Beijing 100094, China

  • Email：guoqing@radi.ac.cn
  • Introduction：郭擎(1980—　)，女，副研究员，研究方向为遥感图像信息提取与处理、图像配准、图像融合和图像加密等。E-mail：guoqing@radi.ac.cn
Qing GUO1*,  
  • Affiliation：

    Institute of Remote Sensing and Digital Earth, Chinese Academy of Sciences, Beijing 100094, China

An LI1,  
  • Affiliation：

    Institute of Remote Sensing and Digital Earth, Chinese Academy of Sciences, Beijing 100094, China

Jun CHEN1,  
  • Affiliation：

    Institute of Remote Sensing and Digital Earth, Chinese Academy of Sciences, Beijing 100094, China

Bo CHEN1,  
  • Affiliation：

    Institute of Remote Sensing and Digital Earth, Chinese Academy of Sciences, Beijing 100094, China

Xuxiang FENG1

Resümee

The size and amount of remote sensing images constantly increase with the improving resolution of remote sensing images. Meanwhile, the development of remote sensing applications also requires high image registration performance. Therefore, an automatic fast feature-level image registration method for high-resolution remote sensing images is proposed. The method includes five steps. First, the reference image and the image to be registered are processed by Haar wavelet transform to obtain the low-frequency approximate images to match. Then, the original images are registered according to the matching result of the approximate images, thereby potentially effectively reducing calculation and improving registration speed. Second, edges in the optical image are extracted by the Canny operator, and edges in the SAR image are extracted by the Ratio Of Averages (ROA) operator. Then, the edge line features are transformed into point features. The use of edge point features can achieve positioning accuracy and acquire stable features. Third, in the feature matching session, the main and auxiliary directions of the point features are considered such that each point feature has multiple directions to enhance the robustness of image registration. Then, the initial matching points are determined by the ratio of the minimum angle to the second minimum angle, which is less than a threshold. Fourth, in the matching point pair filtering session, the random sample consensus is enhanced to improve registration accuracy by adding the constraint condition. The high-quality matching point pairs are selected to fit the model parameters. Finally, in the affine session, the block thought is used to uniformly select matching point pairs to be evenly distributed in the image to avoid the local optimal problem on the registration and further improve image registration accuracy. To verify the efficiency of the method, experiments are conducted under the following conditions: the same sensor optical image registration and sensor SAR image registration, image registration among different bands, image registration with different resolutions, and image registration of different satellite sensors with large size. High resolution WorldView-2, Pleiades, and TerraSAR images are used to perform the experiments. The proposed method is compared with the typical SIFT and SURF algorithms. Four quantitative evaluation indexes, namely, Matching Ratio (MR), Matching Efficiency (ME), Root Mean Square Error (RMSE), and time consumed are used for the registration result evaluation. Experimental results show that the proposed method effectively achieves high registration accuracy under the different conditions. An automatic fast feature-level image registration method for high-resolution remote sensing images is proposed. Multiple datasets of registration experimental results for high-resolution remote sensing images indicate that the proposed method can be rapidly implemented and has high accuracy and strong robustness.

Schlüsselwort

remote sensing registration;high resolution remote sensing image automatic registration;image matching;feature matching;feature extraction

References

  1. 1.
    Bay H, Ess A, Tuytelaars T and Van Gool L. 2008. Speeded-up robust features (SURF). Computer Vision and Image Understanding, 110(3): 346–359
  2. 2.
    Bay H, Tuytelaars T and Van Gool L. 2006. Surf: speeded up robust features//Proceedings of the 9th European Conference on Computer Vision. Graz, Austria: Springer: 404–417 [DOI: 10.1007/11744023_32]
  3. 3.
    Cai T F, Zhu F, Hao Y M and Fan H J. 2015. Pseudo-color processing of gray images for human visual detection and recognition. Infrared and Laser Engineering, 44(S1): 213–219 (
  4. 4.
    Canny J. 1986. A computational approach to edge detection. IEEE Transactions on Pattern Analysis and Machine Intelligence, PAMI-8(6): 679–698 [DOI: 10.1109/TPAMI.1986.4767851]
  5. 5.
    Chen H M, Varshney P K and Arora M K. 2003. Performance of mutual information similarity measure for registration of multitemporal remote sensing images. IEEE Transactions on Geoscience and Remote Sensing, 41(11): 2445–2454
  6. 6.
    Eastman R D, Le Moigne J and Netanyahu N S. 2007. Research issues in image registration for remote sensing//Proceedings of 2007 IEEE Conference on Computer Vision and Pattern Recognition. Minneapolis, MN, USA: IEEE: 1–8 [DOI: 10.1109/CVPR.2007.383423]
  7. 7.
    Fan B, Huo C L, Pan C H and Kong Q Q. 2013. Registration of optical and SAR satellite images by exploring the spatial relationship of the improved sift. IEEE Geoscience and Remote Sensing Letters, 10(4): 657–661
  8. 8.
    Fischler M A and Bolles R C. 1981. Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Communications of the ACM, 24(6): 381–395
  9. 9.
    Gu Y J, Ren K, Wang P C and Gu G H. 2016. Polynomial fitting-based shape matching algorithm for multi-sensors remote sensing images. Infrared Physics and Technology, 76: 386–392
  10. 10.
    Holia M S and Thakar V K. 2012. Mutual information based image registration for MRI and CT SCAN brain images//Proceedings of 2012 International Conference on Audio, Language and Image Processing. Shanghai, China: IEEE: 78–83 [DOI: 10.1109/ICALIP.2012.6376590]
  11. 11.
    Huang F H, Mao Z Y and Shi W Z. 2016. ICA-ASIFT-based multi-temporal matching of high-resolution remote sensing urban images. Cybernetics and Information Technologies, 16(5): 34–49
  12. 12.
    Ke Y and Sukthankar R. 2004. PCA-SIFT: a more distinctive representation for local image descriptors//Proceedings of 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Washington, DC, USA: IEEE: 506–513 [DOI: 10.1109/CVPR.2004.1315206]
  13. 13.
    Kupfer B, Netanyahu N S and Shimshoni I. 2015. An efficient SIFT-based mode-seeking algorithm for sub-pixel registration of remotely sensed images. IEEE Geoscience and Remote Sensing Letters, 12(2): 379–383
  14. 14.
    Lei T J, Li L, Kan G Y, Zhang Z B, Sun T, Zhang X L, Ma J W and Huang S F. 2016. Automatic registration of unmanned aerial vehicle remote sensing images based on an improved sift algorithm//Proceedings of SPIE Volume 10033, Eighth International Conference on Digital Image Processing. Chengdu, China: SPIE: 10033 [DOI: 10.1117/12.2245126]
  15. 15.
    Li J Y, Hu Q W and Ai M Y. 2016. Robust feature matching for remote sensing image registration based on Lq-estimator. IEEE Geoscience and Remote Sensing Letters, 13(12): 1989–1993
  16. 16.
    Li X M, Zheng L and Hu Z Y. 2006. SIFT based automatic registration of remotely-sensed imagery. Journal of Remote Sensing, 10(6): 885–892 (
  17. 17.
    Liu F Q, Bi F K, Chen L, Shi H and Liu W. 2016. Feature-area optimization: a novel SAR image registration method. IEEE Geoscience and Remote Sensing Letters, 13(2): 242–246
  18. 18.
    Liu X J, Zhou Y, Ling J G, Shen H B and Yang J. 2007. Patch-based SAR image automatic registration. Computer Engineering, 33(4): 176–178 (
  19. 19.
    Lowe D G. 1999. Object recognition from local scale-invariant features. Proceeding of the 7th International Conference on Computer Vision. Kerkyra, Greece: IEEE: 1150–1157 [DOI: 10.1109/ICCV.1999.790410]
  20. 20.
    Lowe D G. 2004. Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision, 60(2): 91–110
  21. 21.
    Ma J L, Chan J C W and Canters F. 2010. Fully automatic subpixel image registration of multiangle CHRIS/proba data. IEEE Transactions on Geoscience and Remote Sensing, 48(7): 2829–2839
  22. 22.
    Ma J Y, Zhou H B, Zhao J, Gao Y, Jiang J J and Tian J W. 2015. Robust feature matching for remote sensing image registration via locally linear transforming. IEEE Transactions on Geoscience and Remote Sensing, 53(12): 6469–6481
  23. 23.
    Merkle N, Müller R, Schwind P, Palubinskas G and Reinartz P. 2015. A new approach for optical and SAR satellite image registration. ISPRS Annals of Photogrammetry, Remote Sensing and Spatial Information Sciences, II-3/W4: 119–126 [DOI: 10.5194/isprsannals-II-3-W4-119–2015]
  24. 24.
    Murphy J M, Moigne J L, Harding D J. 2016. Automatic image registration of multimodal remotely sensed data with global shearlet features. IEEE Transactions on Geoscience and Remote Sensing, 54(3): 1685–1704
  25. 25.
    Nagarajan S and Schenk T. 2016. Feature-based registration of historical aerial images by Area Minimization. ISPRS Journal of Photogrammetry and Remote Sensing, 116: 15–23
  26. 26.
    Paul S and Pati U C. 2016. Remote sensing optical image registration using modified uniform robust SIFT. IEEE Geoscience and Remote Sensing Letters, 13(9): 1300–1304
  27. 27.
    Pramote O U and Piamsa-nga P. 2015. Improve accuracy of disparity map for stereo images using sift and weighted color model//Proceedings of the 7th International Conference on Knowledge and Smart Technology. Chonburi, Thailand: IEEE: 109–114 [DOI: 10.1109/KST.2015.7051470]
  28. 28.
    Rong W B, Li Z J, Zhang W and Sun L N. 2014. An improved canny edge detection algorithm//Proceedings of 2014 IEEE International Conference on Mechatronics and Automation. Tianjin, China: IEEE: 577–582 [DOI: 10.1109/ICMA.2014.6885761]
  29. 29.
    Sedaghat A and Ebadi H. 2015a. Distinctive order based self-similarity descriptor for multi-sensor remote sensing image matching. ISPRS Journal of Photogrammetry and Remote Sensing, 108: 62–71
  30. 30.
    Sedaghat A and Ebadi H. 2015b. Remote sensing image matching based on adaptive binning SIFT descriptor. IEEE Transactions on Geoscience and Remote Sensing, 53(10): 5283–5293
  31. 31.
    Suri S and Reinartz P. 2010. Mutual-information-based registration of terraSAR-X and Ikonos imagery in urban areas. IEEE Transactions on Geoscience and Remote Sensing, 48(2): 939–949
  32. 32.
    Touzi R, Lopes A and Bousquet P. 1988. A statistical and geometrical edge detector for SAR images. IEEE Transactions on Geoscience and Remote Sensing, 26(6): 764–773
  33. 33.
    Xiang S W, Wen G J, Gao F and Wu Y J. 2015. High resolution remote sensing image registration method based on multi-model representation. Transducer and Microsystem Technologies, 34(10): 22–24, 28 (
  34. 34.
    You H J and Hu Y F. 2014. Investigation on fine registration for SAR and optical image. Journal of Radars, 3(1): 78–84 (
  35. 35.
    Zhang Q, Cao Z G, Hu Z W, Jia Y H and Wu X L. 2015. Joint image registration and fusion for panchromatic and multispectral images. IEEE Geoscience and Remote Sensing Letters, 12(3): 467–471
  36. 36.
    Zhao C Y and Goshtasby A A. 2016. Registration of multitemporal aerial optical images using line features. ISPRS Journal of Photogrammetry and Remote Sensing, 117: 149–160
  37. 37.
    Zhu H, Li Y F, Yu J M, Leung H and Li Y H. 2014. Ensemble registration of multisensor images by a variational bayesian approach. IEEE Sensors Journal, 14(8): 2698–2705
  38. 38.
    Zitová B and Flusser J. 2003. Image registration methods: a survey. Image and Vision Computing, 21(11): 977–1000

Lesen Sie die ganze Passage

The above content is generated by Large Model Translation. The translated content is for reference only. We do not assume any commercial or legal responsibilty for any consequences arising from the use of our website