Parallel color balancing method using adaptive block Wallis algorithm for image mosaicking

Shuo LI; Hui WANG; Liyong WANG; Xiangzhou YU; Le YANG

doi:10.11834/jrs.20197519

Views : 0 下载量: 1313 CSCD: 2

PDF
Export
Share
Collection
Album

Parallel color balancing method using adaptive block Wallis algorithm for image mosaicking
Vol. 23, Issue 4, Pages: 706-716(2019)
Received：20 December 2017，

Accepted：20 July 2018，

Published：2019-07
DOI： 10.11834/jrs.20197519
稿件说明：

移动端阅览

李烁, 王慧, 王利勇, 于翔舟, 杨乐. 2019. 自适应分块加权Wallis并行匀色. 遥感学报, 23(4): 706–716 DOI： 10.11834/jrs.20197519.

Li S, Wang H, Wang L Y, Yu X Z and Yang L. 2019. Parallel color balancing method using adaptive block Wallis algorithm for image mosaicking. Journal of Remote Sensing, 23(4): 706–716 DOI： 10.11834/jrs.20197519.

摘要

针对区域范围内多幅待镶嵌影像之间的色彩差异问题，提出一种基于GPU的分块加权Wallis并行匀色算法。首先，根据变异系数对影像自适应分块并利用双线性插值确定每一个像素的变换参数，利用加权Wallis变换消除影像间的色彩差异。然后，为了控制区域整体的匀色质量，利用Voronoi图和Dijkstra算法确定影像间的处理顺序。最后，利用GPU技术进行并行任务设计并从配置划分、存储器访问和指令吞吐量等方面进行优化，提高算法运算效率。实验结果表明，本文方法既能有效地消除影像间色彩差异，又能消除影像间的对比度差异。与CPU串行算法相比，GPU并行算法显著减少了计算时间，加速比最高达到60倍以上。

Abstract

Mosaicked remote sensing images that cover large areas are important in image analysis and application. However

different degrees of color and contrast differences are observed between images due to the influence of sensor and external factors

such as light and fog

which complicate image mosaicking. Therefore

eliminating the differences between adjacent images and ensuring consistent colors in the large area (i.e.

color balancing) are becoming increasingly significant. The acquisition cycle of remote sensing data is shortened and the amount of data is increased dramatically with the development of the sensor technology. The changes bring challenges to the efficiency of color balancing of remote sensing images. The traditional serial processing model based on CPU also cannot meet the requirements of fast processing mass data to handle emergency response. To solve the aforementioned problems

a parallel color balancing method based on adaptive block Wallis algorithm for image mosaicking was proposed. First

the images were adaptively divided into blocks depending on the coefficients of variation. Bilinear interpolation was used to determine the transformation parameters of each pixel

and the Wallis transform was adopted to eliminate the color differences between adjacent images. Second

Voronoi diagram was generated to determine the adjacent relation of images. Dijkstra algorithm was used to calculate the shortest path and determine the processing sequence for controlling the color consistency of the entire region. Finally

GPU technology was used to parallelize the proposed method for improving the efficiency. Bilinear interpolation and linear transformation are repetitive and dense computing tasks

which were directly assigned to each thread and executed simultaneously. The reduction method was adopted to parallelize the calculation of mean and standard deviation. Moreover

configuration

memory access

and instruction throughput were optimized to further improve the efficiency. Two groups of experiments were implemented on orthoimages to verify the effectiveness and efficiency of the proposed method. Experimental results showed that the proposed method was superior to the traditional Wallis method and Inpho in visual effect and quantitative evaluation. Moreover

the highest speed-up of the proposed parallel algorithm based on GPU could be more than 60 times that of the serial color balancing method based on CPU. The proposed method can effectively eliminate the color and contrast differences between adjacent images

thereby decreasing the difficulty in seamline detection. Meanwhile

the efficiency of the method is improved dramatically with the proposed parallel acceleration strategy. The performance of the proposed method is excellent in improving the quality and efficiency of color balancing and reducing the difficulty in image mosaicking. Moreover

the proposed method is sufficiently efficient to meet the requirements of fast color balancing of remote sensing images.

关键词

Keywords

references

Canty M J and Nielsen A A. 2008. Automatic radiometric normalization of multitemporal satellite imagery with the iteratively re-weighted MAD transformation. Remote Sensing of Environment, 112(3): 1025–1036

常方正, 赵银娣, 刘善磊. 2016. 遥感影像CVA变化检测的CUDA并行算法设计. 遥感学报, 20(1): 114–128

Chang F Z, Zhao Y D and Liu S L. 2016. CUDA parallel algorithm for CVA change detection of remote sensing imagery. Journal of Remote Sensing, 20(1): 114–128

Chen C, Chen Z J, Li M C, Liu Y X, Cheng L and Ren Y B. 2014. Parallel relative radiometric normalisation for remote sensing image mosaics. Computers and Geosciences, 73: 28–36

陈建乐, 刘济林, 叶建洪, 陈妤姗. 2007. 多视点视频中基于局部直方图匹配的亮度和色差校正. 中国图象图形学报, 12(11): 1992–1999

Chen J L, Liu J L, Ye J H and Chen Y S. 2007. Luminance and chrominance correction for multi-view video using overlapped local histogram matching. Journal of Image and Graphics, 12(11): 1992–1999

方留杨, 王密, 李德仁. 2013. CPU和GPU协同处理的光学卫星遥感影像正射校正方法. 测绘学报, 42(5): 668–675

Fang L Y, Wang M and Li D R. 2013. A CPU-GPU co-processing orthographic rectification approach for optical satellite imagery. Acta Geodaetica et Cartographica Sinica, 42(5): 668–675

Helmer E H and Ruefenacht B. 2005. Cloud-free satellite image mosaics with regression trees and histogram matching. Photogrammetric Engineering and Remote Sensing, 71(9): 1079–1089

李烁, 王慧, 王利勇, 程挺, 王重阳. 2016. 最小传递路径的正射影像色彩一致性处理方法. 测绘科学技术学报, 33(6): 593–598

Li S, Wang H, Wang L Y, Cheng T and Wang C Y. 2016. Color consistency processing of orthoimages based on the minimum transfer path. Journal of Geomatics Science and Technology, 33(6): 593–598

李治江. 2005. 彩色影像色调重建的理论与实践. 武汉: 武汉大学

Li Z J. 2005. Theory and Practice on Tone Reproduction of Color Photos. Wuhan: Wuhan University

Lin C H, Lin B Y, Lee K Y and Chen Y C. 2015. Radiometric normalization and cloud detection of optical satellite images using invariant pixels. ISPRS Journal of Photogrammetry and Remote Sensing, 106: 107–117

Pan J, Wang M, Li D R and Li J L. 2010. A network-based radiometric equalization approach for digital aerial orthoimages. IEEE Geoscience and Remote Sensing Letters, 7(2): 401–405

孙明伟. 2009. 正射影像全自动快速制作关键技术研究. 武汉: 武汉大学

Sun M W. 2009. Research on Key Technology of Automatical and Fast DOM Generation. Wuhan: Wuhan University

王密, 潘俊. 2006. 面向无缝影像数据库应用的一种新的光学遥感影像色彩平衡方法. 国土资源遥感, 18(4): 10–13

Wang M and Pan J. 2006. A new color balance method for large-scale seamless image database. Remote Sensing for Land and Resources, 18(4): 10–13

王宗跃, 马洪超, 明洋. 2014. 基于GPGPU的全波形并行分解算法. 遥感学报, 18(6): 1217–1222

Wang Z Y, Ma H C and Ming Y. 2014. GPGPU-based parallel algorithm for full waveform decomposition. Journal of Remote Sensing, 18(6): 1217–1222

吴炜, 骆剑承, 李均力, 杨海平, 沈占锋. 2012. 面向遥感影像镶嵌的SVR色彩一致性处理. 中国图象图形学报, 17(12): 1561–1567

Wu W, Luo J C, Li J L, Yang H P and Shen Z F. 2012. Support vector regression color normalization method for image mosaic. Journal of Image and Graphics, 17(12): 1561–1567

吴炜, 沈占锋, 李均力, 杨海平, 骆剑承. 2013. 联合概率密度脊提取的影像镶嵌色彩一致性处理方法. 测绘学报, 42(2): 247–252

Wu W, Shen Z F, Li J L, Yang H P and Luo J C. 2013. Ridge of joint probability density based color normalization method for image mosaic. Acta Geodaetica et Cartographica Sinica, 42(2): 247–252

闸旋. 2013. CPU+GPU单机异构环境下遥感数据并行处理技术研究. 郑州: 解放军信息工程大学

Zha X. 2013. Research on Parallel Processing Technologies of Remote Sensing Data Based on CPU+GPU under Single-Computer. Zhengzhou: Information Engineering University

Zhang L P, Wu C and Du B. 2014. Automatic radiometric normalization for multitemporal remote sensing imagery with iterative slow feature analysis. IEEE Transactions on Geoscience and Remote Sensing, 52(10): 6141–6155

张鹏强, 余旭初, 刘智, 李建胜, 万刚. 2006. 多时相遥感图像相对辐射校正. 遥感学报, 10(3): 339–344

Zhang P Q, Yu X C, Liu Z, Li J S and Wan G. 2006. A study on relative radiometric correction of multitemporal remote sensing images. Journal of Remote Sensing, 10(3): 339–344

Zhang Y J, Yu L, Sun M W and Zhu X Y. 2017. A mixed radiometric normalization method for mosaicking of high-resolution satellite imagery. IEEE Transactions on Geoscience and Remote Sensing, 55(5): 2792–2984

Zhou X G. 2015. Multiple auto-adapting color balancing for large number of images. International Archives of the Photogrammetry Remote Sensing and Spatial Information Sciences, XL-7/w3: 735-742

Alert me when the article has been cited

提交

Landslide susceptibility assessment of the Luding 9.5 earthquake area by fusing LT-1 ascending and descending ground deformation observations

Small wetland extraction based on Sentinel-1 time-series data and MultiRocket-RF model

Identification and analysis of forest loss drivers in Africa based on multisource time-series remote sensing products

Hyperspectral image classification network based on multiscale supervised contrastive learning

Comparative verification of cloud particle effective radius at cloud top by satellite retrieval and airborne measurement