Scene classification dataset using the Tiangong-1 hyperspectral remote sensing imagery and its applications

  • role: First author第一作者
  • Affiliation:

    Key Laboratory of Space Utilization, Technology and Engineering Center for Space Utilization, Chinese Academy of Sciences, Beijing 100094, China

  • Email:liukang@csu.ac.cn
  • Introduction:刘康,1989年生,女,硕士研究生, 研究方向为图像智能处理、遥感应用。E-mail: liukang@csu.ac.cn
LIU Kang,  
  • Affiliation:

    Key Laboratory of Space Utilization, Technology and Engineering Center for Space Utilization, Chinese Academy of Sciences, Beijing 100094, China

ZHOU Zhuang,  
  • Affiliation:

    Key Laboratory of Space Utilization, Technology and Engineering Center for Space Utilization, Chinese Academy of Sciences, Beijing 100094, China

LI Shengyang,  
  • Affiliation:

    Key Laboratory of Space Utilization, Technology and Engineering Center for Space Utilization, Chinese Academy of Sciences, Beijing 100094, China

LIU Yunfei,  
  • Affiliation:

    Key Laboratory of Space Utilization, Technology and Engineering Center for Space Utilization, Chinese Academy of Sciences, Beijing 100094, China

WAN Xue,  
  • Affiliation:

    Key Laboratory of Space Utilization, Technology and Engineering Center for Space Utilization, Chinese Academy of Sciences, Beijing 100094, China

LIU Zhiwen,  
  • Affiliation:

    Key Laboratory of Space Utilization, Technology and Engineering Center for Space Utilization, Chinese Academy of Sciences, Beijing 100094, China

TAN Hong,  
  • Affiliation:

    Key Laboratory of Space Utilization, Technology and Engineering Center for Space Utilization, Chinese Academy of Sciences, Beijing 100094, China

ZHANG Wanfeng

Resümee

Remote sensing image scene classification is an important means of remote sensing image interpretation, which has important application value in land and resources investigation, ecological environment monitoring, disaster assessment, target interpretation and so on. In recent years, deep learning has become a research hotspot in the field of remote sensing scene classification, and data set is the basis for its development. Most of the existing remote sensing scene classification datasets are true color images with single scale and less spectral information. And other hyperspectral data sets have relatively small data coverage. The data of Tiangong-1 Hyperspectral Imager has the characteristics of high spatial resolution, high hyperspectral resolution and wide coverage. It can be used for comprehensive feature extraction and analysis of spectral spatial information, which can provide more abundant data sources for remote sensing image classification application research, and make up for the deficiency of spectral information and limited application of common remote sensing scene classification data sets. In this study, based on the high-quality data acquired by Tiangong-1 Hyperspectral Imager, Tiangong-1 Hyperspectral Remote Sensing Scene Classification data set (TG1HRSSC) is produced through radiation correction, geometric correction, spatial clipping, band screening, and data quality analysis and control. The dataset, which contains the 204 hyperspectral multiresolution image data of nine typical scenes (e.g., city, farmland, forest, pond culture, desert, lake, river and airport), is published and shared in the Space Application Data Promoting Service Platform for China Manned Space Engineering (http://www.msadc.cn [2019-09-10]). The dataset includes one band of 5 m resolution full spectrum, 54 bands of 10 m resolution visible and near-infrared spectrum, and 52 bands of 20 m resolution short-wave infrared spectrum. In addition, this paper describes and analyzes the data set from four aspects: scene distribution, time distribution, spectral distribution and scale distribution. In order to test the application effect of data classification, three classical convolution neural networks (VGG-VD-16, AlexNet and GoogleLeNet) are selected to train the data sets by transfer learning. The overall classification accuracy is 91.52 ± 0.60, 90.47 ± 0.23 and 89.12 ± 0.34, respectively. Results show that the scene classification of the dataset is effective. In following research, the network model can be designed to make full use of the multi-spectral characteristics of the data to achieve more accurate scene classification, and to improve the generalization ability of existing models by using the characteristics of multi-scale data. The data set (TG1HRSSC) has the advantages of hyperspectral, high spatial resolution and multi-scale. The abundant spectral information and fine spatial information provide data support for the research of target recognition of fine ground objects, remote sensing scene classification, remote sensing semantic understanding and other applications, which has unique value and application prospects.

Schlüsselwort

Tiangong-1;Hyperspectral Imager;scene classification;data set;deep learning

References

  1. 1.
    Deng J, Dong W, Socher R, Li L J, Li K and Li F F. 2009. ImageNet: a large-scale hierarchical image database//Proceedings of 2009 IEEE Conference on Computer Vision and Pattern Recognition. Miami, USA: IEEE
  2. 2.
    Gao M, Zhang S C and Li S Y. 2014. Tiangong-1 hyperspectral remote sensing and application. Journal of remote sensing, 18(S1): 2-10
  3. 3.
    Helber P, Bischke B, Dengel A and Borth D. 2019. EuroSAT: a novel dataset and deep learning benchmark for land use and land cover classification. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 12(7): 2217-2226
  4. 4.
    Krizhevsky A, Sutskever I and Hinton G E. 2012. ImageNet classification with deep convolutional neural networks//Proceedings of the 26th Annual Conference on Neural Information Processing Systems. Lake Tahoe, USA: NIPS
  5. 5.
    LeCun Y, Bottou L, Bengio Y and Haffner P. 1998. Gradient-based learning applied to document recognition. Proceedings of the IEEE, 86(11): 2278-2324
  6. 6.
    Li S Y, Liu Z W, Liu K and Zhao Z F. 2019. Advances in application of space hyperspectral remote sensing (invited). Infrared and Laser Engineering, 48(3): 0303001
  7. 7.
    Li Z Q, Zhu R F, Gao F, Meng X Y, An Y and Zhong X. 2018. Hyperspectral remote sensing image classification based on three-dimensional convolution neural network combined with conditional random field optimization. Acta Optica Sinica, 38(8): 0828001
  8. 8.
    Liu Z W, Liu D S and Wei J B. 2014. Rigorous geometric model of Tiangong-1 hyperspectral spectrometer. Journal of remote sensing, 18(S1): 62-67
  9. 9.
    Marmanis D, Datcu M, Esch T and Stilla U. 2016. Deep learning earth observation classification using ImageNet pretrained networks. IEEE Geoscience and Remote Sensing Letters, 13(1): 105-109
  10. 10.
    Simonyan K and Zisserman A. 2015. Very deep convolutional networks for large-scale image recognition//Proceedings of the 3rd International Conference on Learning Representations. San Diego, USA: [s.n.]
  11. 11.
    Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, Erhan D, Vanhoucke V and Rabinovich A. Going deeper with convolutions[C]//Proceedings of the IEEE conference on computer vision and pattern recognition. 2015: 1-9.
  12. 12.
    Xia G S, Yang W, Delon J, Gousseau Y, Sun H and Maˆıtre H. Structural high-resolution satellite image indexing [C]. 2010.
  13. 13.
    Xia G S, Hu J W, Hu F, Shi B G, Bai X, Zhong Y F, Zhang L P and Lu X Q. 2017. AID: a benchmark data set for performance evaluation of aerial scene classification. IEEE Transactions on Geoscience and Remote Sensing, 55(7): 3965-3981
  14. 14.
    Xu M. 2017. Hyperspectral Image Classification Based on Deep Convolutional Neural Networks. Xi’an: Xidian University
  15. 15.
    Yang Y and Newsam S. 2010. Bag-of-visual-words and spatial extensions for land-use classification//Proceedings of the 18th SIGSPATIAL International Conference on Advances in Geographic Information Systems. San Jose, USA: ACM: 270-279
  16. 16.
    Zhang W J, Wu Y F, Liu L Y, Zhang B, Li X Z and Zhang J X. 2014. Tiangong-1 hyperspectral imager radiometric and spectral correction. Journal of Remote Sensing, 18(S1): 56-61
  17. 17.
    Zou Q, Ni L H, Zhang T and Wang Q. 2015. Deep learning based feature selection for remote sensing scene classification. IEEE Geoscience and Remote Sensing Letters, 12(11): 2321-2325

Lesen Sie die ganze Passage

The above content is generated by Large Model Translation. The translated content is for reference only. We do not assume any commercial or legal responsibilty for any consequences arising from the use of our website