Parallel color balancing method using adaptive block Wallis algorithm for image mosaicking

  • role: First author第一作者
  • Affiliation:

    Institute of Surveying and Mapping, Information Engineering University, Zhengzhou 450001, China

  • Email:chxyls@163.com
  • Introduction:李烁,1990年生,男,博士研究生,研究方向为数字摄影测量和数字图像处理。E-mail:chxyls@163.com
LI Shuo,  
  • role: Corresponding author通信作者
  • Affiliation:

    Institute of Surveying and Mapping, Information Engineering University, Zhengzhou 450001, China

  • Email:zzch0908@163.com
  • Introduction:王慧,1968年生,女,教授,研究方向为航空航天信息获取与处理。E-mail: zzch0908@163.com
WANG Hui*,  
  • Affiliation:

    Institute of Surveying and Mapping, Information Engineering University, Zhengzhou 450001, China

WANG Liyong,  
  • Affiliation:

    Institute of Surveying and Mapping, Information Engineering University, Zhengzhou 450001, China

YU Xiangzhou,  
  • Affiliation:

    Institute of Surveying and Mapping, Information Engineering University, Zhengzhou 450001, China

YANG Le

реферат

Mosaicked remote sensing images that cover large areas are important in image analysis and application. However, different degrees of color and contrast differences are observed between images due to the influence of sensor and external factors, such as light and fog, which complicate image mosaicking. Therefore, eliminating the differences between adjacent images and ensuring consistent colors in the large area (i.e., color balancing) are becoming increasingly significant. The acquisition cycle of remote sensing data is shortened and the amount of data is increased dramatically with the development of the sensor technology. The changes bring challenges to the efficiency of color balancing of remote sensing images. The traditional serial processing model based on CPU also cannot meet the requirements of fast processing mass data to handle emergency response. To solve the aforementioned problems, a parallel color balancing method based on adaptive block Wallis algorithm for image mosaicking was proposed. First, the images were adaptively divided into blocks depending on the coefficients of variation. Bilinear interpolation was used to determine the transformation parameters of each pixel, and the Wallis transform was adopted to eliminate the color differences between adjacent images. Second, Voronoi diagram was generated to determine the adjacent relation of images. Dijkstra algorithm was used to calculate the shortest path and determine the processing sequence for controlling the color consistency of the entire region. Finally, GPU technology was used to parallelize the proposed method for improving the efficiency. Bilinear interpolation and linear transformation are repetitive and dense computing tasks, which were directly assigned to each thread and executed simultaneously. The reduction method was adopted to parallelize the calculation of mean and standard deviation. Moreover, configuration, memory access, and instruction throughput were optimized to further improve the efficiency. Two groups of experiments were implemented on orthoimages to verify the effectiveness and efficiency of the proposed method. Experimental results showed that the proposed method was superior to the traditional Wallis method and Inpho in visual effect and quantitative evaluation. Moreover, the highest speed-up of the proposed parallel algorithm based on GPU could be more than 60 times that of the serial color balancing method based on CPU. The proposed method can effectively eliminate the color and contrast differences between adjacent images, thereby decreasing the difficulty in seamline detection. Meanwhile, the efficiency of the method is improved dramatically with the proposed parallel acceleration strategy. The performance of the proposed method is excellent in improving the quality and efficiency of color balancing and reducing the difficulty in image mosaicking. Moreover, the proposed method is sufficiently efficient to meet the requirements of fast color balancing of remote sensing images.

ключеви́че слова́

remote sensing;color balancing;GPU parallel;adaptive block;Wallis transformation;reduction of sum

References

  1. 1.
    Canty M J and Nielsen A A. 2008. Automatic radiometric normalization of multitemporal satellite imagery with the iteratively re-weighted MAD transformation. Remote Sensing of Environment, 112(3): 1025–1036
  2. 2.
    Chang F Z, Zhao Y D and Liu S L. 2016. CUDA parallel algorithm for CVA change detection of remote sensing imagery. Journal of Remote Sensing, 20(1): 114–128
  3. 3.
    Chen C, Chen Z J, Li M C, Liu Y X, Cheng L and Ren Y B. 2014. Parallel relative radiometric normalisation for remote sensing image mosaics. Computers and Geosciences, 73: 28–36
  4. 4.
    Chen J L, Liu J L, Ye J H and Chen Y S. 2007. Luminance and chrominance correction for multi-view video using overlapped local histogram matching. Journal of Image and Graphics, 12(11): 1992–1999
  5. 5.
    Fang L Y, Wang M and Li D R. 2013. A CPU-GPU co-processing orthographic rectification approach for optical satellite imagery. Acta Geodaetica et Cartographica Sinica, 42(5): 668–675
  6. 6.
    Helmer E H and Ruefenacht B. 2005. Cloud-free satellite image mosaics with regression trees and histogram matching. Photogrammetric Engineering and Remote Sensing, 71(9): 1079–1089
  7. 7.
    Li S, Wang H, Wang L Y, Cheng T and Wang C Y. 2016. Color consistency processing of orthoimages based on the minimum transfer path. Journal of Geomatics Science and Technology, 33(6): 593–598
  8. 8.
    Li Z J. 2005. Theory and Practice on Tone Reproduction of Color Photos. Wuhan: Wuhan University
  9. 9.
    Lin C H, Lin B Y, Lee K Y and Chen Y C. 2015. Radiometric normalization and cloud detection of optical satellite images using invariant pixels. ISPRS Journal of Photogrammetry and Remote Sensing, 106: 107–117
  10. 10.
    Pan J, Wang M, Li D R and Li J L. 2010. A network-based radiometric equalization approach for digital aerial orthoimages. IEEE Geoscience and Remote Sensing Letters, 7(2): 401–405
  11. 11.
    Sun M W. 2009. Research on Key Technology of Automatical and Fast DOM Generation. Wuhan: Wuhan University
  12. 12.
    Wang M and Pan J. 2006. A new color balance method for large-scale seamless image database. Remote Sensing for Land and Resources, 18(4): 10–13
  13. 13.
    Wang Z Y, Ma H C and Ming Y. 2014. GPGPU-based parallel algorithm for full waveform decomposition. Journal of Remote Sensing, 18(6): 1217–1222
  14. 14.
    Wu W, Luo J C, Li J L, Yang H P and Shen Z F. 2012. Support vector regression color normalization method for image mosaic. Journal of Image and Graphics, 17(12): 1561–1567
  15. 15.
    Wu W, Shen Z F, Li J L, Yang H P and Luo J C. 2013. Ridge of joint probability density based color normalization method for image mosaic. Acta Geodaetica et Cartographica Sinica, 42(2): 247–252
  16. 16.
    Zha X. 2013. Research on Parallel Processing Technologies of Remote Sensing Data Based on CPU+GPU under Single-Computer. Zhengzhou: Information Engineering University
  17. 17.
    Zhang L P, Wu C and Du B. 2014. Automatic radiometric normalization for multitemporal remote sensing imagery with iterative slow feature analysis. IEEE Transactions on Geoscience and Remote Sensing, 52(10): 6141–6155
  18. 18.
    Zhang P Q, Yu X C, Liu Z, Li J S and Wan G. 2006. A study on relative radiometric correction of multitemporal remote sensing images. Journal of Remote Sensing, 10(3): 339–344
  19. 19.
    Zhang Y J, Yu L, Sun M W and Zhu X Y. 2017. A mixed radiometric normalization method for mosaicking of high-resolution satellite imagery. IEEE Transactions on Geoscience and Remote Sensing, 55(5): 2792–2984
  20. 20.
    Zhou X G. 2015. Multiple auto-adapting color balancing for large number of images. International Archives of the Photogrammetry Remote Sensing and Spatial Information Sciences, XL-7/w3: 735-742

Читать полностью

The above content is generated by Large Model Translation. The translated content is for reference only. We do not assume any commercial or legal responsibilty for any consequences arising from the use of our website