Retrieval of remote sensing images based on semisupervised deep learning

Hongqun ZHANG; Xueying LIU; Sen YANG; Yu LI

doi:10.11834/jrs.20176105

Views : 0 下载量: 698 CSCD: 20

PDF
Export
Share
Collection
Album

Retrieval of remote sensing images based on semisupervised deep learning
Vol. 21, Issue 3, Pages: 406-414(2017)
Received：21 April 2016，

Accepted：18 September 2016，

Published：2017-05
DOI： 10.11834/jrs.20176105
稿件说明：

移动端阅览

DOI：

Hongqun ZHANG, Xueying LIU, Sen YANG, et al. Retrieval of remote sensing images based on semisupervised deep learning[J]. Journal of Remote Sensing, 2017, 21(3): 406-414. DOI： 10.11834/jrs.20176105.

摘要

遥感图像数据的海量性、多样性和复杂性等特点对遥感图像检索的速度和精度提出了更高的要求，其中特征提取是影响遥感图像检索效果的关键。本文方法首先对遥感图像进行预处理，然后基于稀疏自动编码的方法在大量未标注的遥感图像上进行特征学习得到特征字典，基于卷积神经网络的思想，使用训练出来的特征字典对遥感图像进行卷积和池化得到每幅图像的特征图；接下来使用特征图训练Softmax分类器；最后对待检索图像分类，在同一类别中计算特征间的距离，进而实现遥感图像的检索。实验结果表明，该方法能够有效提高遥感图像检索的速度和准确度。

Abstract

Massive data and diversity characteristics exert higher demands on the retrieval of remote sensing images. The feature extraction algorithm is the most outstanding factor that influences the performance of retrieval methods. Traditional feature extraction methods cause the problem of semantic gap

which occurs when the low-level feature does not perfectly reflect or match the purpose of retrieval. BOVW and multilayer cluster analysis have been proposed to solve semantic gap. However

the usability of these methods is limited given their dependence on classification or cluster algorithms and artificiality. A semi supervised deep-learning method was proposed in this paper. This method combines Sparse Auto encoder (SA) and the principle of Convolutional Neural Networks (CNNs). The method involves four steps: first

the remote sensing images are pretreated with the ZCA whitening method. Second

the feature dictionary is extracted using SA

an algorithm that deals with nonannotated data. Subsequently

the feature dictionary is utilized in image convolution following the principle of CNNs

which imitates the neural net of organisms and decreases the number of features. Average pooling is conducted after image convolution. Both convolution and pooling are implemented to reduce model complexity

thus calculating distance faster. Third

the soft max classifier categorizes remote sensing images into five classes. Lastly

the remote sensing image retrieval is sorted based on the Euclidean distance between the query image and database in the same category as the query image. Experimental results based on high-resolution remote sensing images demonstrate that the proposed method is effective and is more accurate than the methods that are based on color and texture features. Image classification before sorting speeds up retrieval by 27.6%. In addition

the semi-supervised deep learning algorithm is stable when the number of returned images increases. Given that the number of neurons in the hidden SA layer and the region size of pooling primarily affect retrieval results

this study conducted several optimization experiments on these two parameters. Moreover

the algorithm in this research performed well when the number of images in the data set and the retrieval accuracy on a larger data set increased

which are meaningful for the retrieval of massive remote sensing images. The semisupervised deep learning algorithm decreases the time of image annotation

which is an exhausting job. Unlike traditional methods that extracts the features of color

texture

and shape

the method in this study directly extracts the feature dictionary from image elements with good accuracy. Moreover

the efficiency of the proposed method is guaranteed by convolution and pooling

which reduce the feature dimension. Furthermore

our experiment proves that this algorithm performs well in retrieving high-resolution remote sensing images.

关键词

Keywords

references

Bengio Y, Lamblin P, Popovici D and Larochelle H. 2006. Greedy layer-wise training of deep networks//Proceedings of the 19th International Conference on Neural Information Processing Systems. Cambridge: MIT Press: 153–160

Bishop C M. 2007. Pattern Recognition and Machine Learning. New York: Springer

Bourlard H and Kamp Y. 1988. Auto-association by multilayer perceptrons and singular value decomposition. Biological Cybernetics, 59(4/5): 291–294

Coates A, Lee H and Ng A Y. 2011. An analysis of single-layer networks in unsupervised feature learning//Proceedings of the 14th International Conference on Artificial Intelligence and Statistics. Fort Lauderdale, FL, USA: JMLR: 215–223

段宝彬, 韩立新, 谢进. 2015. 基于堆叠稀疏自编码的模糊C-均值聚类算法. 计算机工程与应用, 51(4): 154–157

Duan B B, Han L X and Xie J. 2015. Fuzzy C-means clustering algorithm based on stacked sparse autoencoders. Computer Engineering and Applications, 51(4): 154–157

Haralick R M and Shangmugam K. 1973. Texture features for image classification. IEEE Transaction on Systems, SMC-3(6): 768–780 (未找到本条文献信息, 请核对)

Hinton G E and Salakhutdinov R R. 2006. Reducing the dimensionality of data with neural networks. Science, 313(5786): 504–507

Hu F, Xia G S, Hu J W and Zhang L P. 2015a. Transferring deep convolutional neural networks for the scene classification of high-resolution remote sensing imagery. Remote Sensing, 7(11): 14680–14707

Hu F, Xia G S, Hu J W and Zhang L P. 2015b. Transferring deep convolutional neural networks for the scene classification of high-resolution remote sensing imagery. Remote Sensing, 7(11): 14680–14707

黄劲, 孙洋, 徐浩然. 2013. 稀疏编码(Sparse coding)在图像检索中的应用. 数字技术与应用, (11): 76–77, 81 (未找到本条文献英文信息, 请核对)

Huang J, Sun Y and Xu H R. 2013. The application of Sparse coding on image retrieval. Digital Technology and Application, (11): 76–77, 81

Jia Y Q, Shelhamer E, Donahue J, Karayev S, Long J, Girshick R, Guadarrama S and Darrell T. Caffe: convolutional architecture for fast feature embedding. Eprint Arxiv, 2014: 675–678

Kitamoto A and Takagi M. 1994. Similarity retrieval of satellite cloud imagery based on optimization principle. IEICE Technical Report Pattern Recognition and Understanding, 94(294): 15–22

LeCun Y. 1989. Generalization and network design strategies//Pfeifer R, Schreter Z, Fogelman F and Steels L, eds. Connectionism in Perspective. Zurich, Switzerland: Elsevier: 143–155

LeCun Y, Bengio Y and Hinton G. 2015. Deep learning. Nature, 521(7553): 436–444

李德仁, 宁晓刚. 2006. 一种新的基于内容遥感图像检索的图像分块策略. 武汉大学学报(信息科学版), 31(8): 659–662

Li D R and Ning X G. 2006. A new image decomposition method for content-based remote sensing image retrieval. Geomatics and Information Science of Wuhan University, 31(8): 659–662

刘米娜. 2013. 基于颜色和纹理特征的遥感图像检索. 西安: 西安工业大学

Liu M N. 2013. Remote Sensing Image Retrieval Based on Color and Texture. Xian: Xi’an Technological University

刘鹏宇. 2004. 基于内容的图像特征提取算法的研究. 长春: 吉林大学

Liu P Y. 2004. Study on the Algorithms for Content-based Image Feature Extraction. Changchun: Jilin University

鲁珂, 赵继东, 叶娅兰, 曾家智. 2005. 一种用于图像检索的新型半监督学习算法. 电子科技大学学报, 34(5): 669–671

Lu K, Zhao J D, Ye Y L and Zeng J Z. 2005. Algorithm for semi-supervised learning in image retrieval. Journal of UEST of China, 34(5): 669–671

陆丽珍, 刘仁义, 刘南. 2004. 一种融合颜色和纹理特征的遥感图像检索方法. 中国图象图形学报, 9(3): 328–333

Lu L Z, Liu R Y and Liu N. 2004. Remote sensing image retrieval using color and texture fused features. Journal of Image and Graphics, 9(3): 328–333

Luus F P S, Salmon B P, Van den Bergh F and Maharaj B T J. 2015. Multiview deep learning for land-use classification. IEEE Geoscience and Remote Sensing Letters, 12(12): 2448–2452

Mnih V and Hintion G E. 2010. Learning to detect roads in high-resolution aerial images//Proceedings of the 11th European Conference on Computer Vision. Berlin Heidelberg: Springer: 210–223 [DOI: 10.1007/978-3-642-15567-3_16]

Mojsilovic A and Rogowitz B. 2001. Capturing image semantics with low-level descriptors//Proceedings of the 2001 International Conference on Image Processing. Thessaloniki: IEEE: 18–21 [DOI: 10.1109/ICIP.2001.958942]

Sheikholeslami G, Zhang A D and Bian L. 1999. A multi-resolution content-based retrieval approach for geographic images. GeoInformatica, 3(2): 109–139

王杰, 贾育衡, 赵昕. 2014.基于稀疏自编码器的烟叶成熟度分类. 烟草科技, 46(9):17-19

Wang J, Jia Y H and Zhao X. 2014. Tobacco leaf matupity classification based on sparse auto-encoder. Tobacco Science & Technology, 46(9):17-19

尹宝才, 王文通, 王立春. 2015. 深度学习研究综述. 北京工业大学学报, 41(1): 48–59

Yin B C, Wang W T and Wang L C. 2015. Review of deep learning. Journal of Beijing University of Technology, 41(1): 48–59

Zhao L J, Tang P and Huo L Z. 2014. Land-use scene classification using a concentric circle-structured multiscale bag-of-visual-words model. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 7(12): 4620–4631

Zhu B, Ramsey M and Chen H. 2000. Creating a large-scale content-based airphoto image digital library. IEEE Transactions on Image Processing, 9(1): 163–167

Alert me when the article has been cited

提交

Weakly supervised scale adaptation data augmentation for scene classification of high-resolution remote sensing images

Fine 3D mapping and vegetation spatial differentiation study based on UAV LiDAR point cloud in karst wetland

LAE-Transformer： An airborne LiDAR point cloud segmentation network incorporating local-aware enhancement

A multi-scale InSAR phase filtering method incorporating adaptive enhancement and dynamic screening mechanisms