거리 영상 약지도 의미 변화 감지 방법 및 도시 갱신 동적 지도 연구

  • role: First author第一作者
  • Affiliation:

    Beidou Research Institute, South China Normal University, Foshan 528225, China

    College of Geography Science, South China Normal University, Guangzhou 510631, China

  • Email:2023025220@m.scnu.edu.cn
  • Introduction:彭奕霖,研究方向为街景变化检测。E-mail: 2023025220@m.scnu.edu.cn
PENG Yilin12,  
  • role: Corresponding author通信作者
  • Affiliation:

    College of Geography Science, South China Normal University, Guangzhou 510631, China

  • Email:fuyc@m.scnu.edu.cn
  • Introduction:付迎春,研究方向为定量遥感与城市遥感。E-mail: fuyc@m.scnu.edu.cn
FU Yingchun2*,  
  • Affiliation:

    Beidou Research Institute, South China Normal University, Foshan 528225, China

XING Hanfa1,  
  • Affiliation:

    College of Geography Science, South China Normal University, Guangzhou 510631, China

CHEN Shuqi2,  
  • Affiliation:

    College of Geography Science, South China Normal University, Guangzhou 510631, China

LI Zhenhao2,  
  • Affiliation:

    College of Geography Science, South China Normal University, Guangzhou 510631, China

ZHANG Si2

추상적인

거리 영상은 도시 물리 환경을 인지하는 새로운 형태의 지리 빅데이터입니다. 거리 영상을 통해 입면 변화를 발견하고 변화 의미 범주를 식별하는 것은 도시 갱신의 중요한 인지 수단입니다. 전통적 변화 감지 방법은 거리 영상 변화 객체의 시점 소속(변화 분할)을 직접 구분할 수 없으며, 두 시점의 변화 영역 의미 범주를 효율적으로 인식하기 어렵습니다. 본 논문에서는 Cross-C2PO (Cross-Combine 2 POssible change types) 모델을 제안하여 변화 감지와 시점 분할 과제를 통합하였으며, 기존 이미지 의미 분할 모델을 도입하여 거리 영상 의미 변화 감지를 실현하는 데 도움을 줍니다. 이를 바탕으로, 광저우 주도심 2013-2019년 갱신 변화를 목표로 도시 갱신 동적 지표의 인지 분석 방법을 구축하여, 전후좌우 네 시점의 거리 전경 통합 변화 인지를 수행하고 도시 갱신 동적 지도 제작을 통해 도시 갱신 분포 및 물리 환경 변화 강도를 직관적으로 보여주어 거리 영상과 컴퓨터 비전의 지능형 결합 적용의 혁신적 방법과 사례 연구를 제공합니다.

키워드

도시 갱신;거리 영상;의미 변화 감지;장면 변화 감지;약지도;동적지표

References

  1. 1.
    Alcantarilla P F, Stent S, Ros G, Arroyo R and Gherardi R. 2018. Street-view change detection with deconvolutional networks. Autonomous Robots, 42(7): 1301-1322
  2. 2.
    Badland H M, Opit S, Witten K, Kearns R A and Mavoa S. 2010. Can virtual streetscape audits reliably replace physical streetscape audits? Journal of Urban Health, 87(6): 1007-1016
  3. 3.
    Berland A and Lange D A. 2017. Google Street View shows promise for virtual street tree surveys. Urban Forestry and Urban Greening, 21: 11-15
  4. 4.
    Caye Daudt R, Le Saux B and Boulch A. 2018. Fully convolutional siamese networks for change detection//2018 25th IEEE International Conference on Image Processing (ICIP). Athens: IEEE: 4063-4067
  5. 5.
    Chen L C, Papandreou G, Schroff F and Adam H. 2017. Rethinking atrous convolution for semantic image segmentation. arXiv:1706.05587
  6. 6.
    Chen S, Yang K L and Stiefelhagen R. 2021. DR-TANet: dynamic receptive temporal attention network for street scene change detection//2021 IEEE Intelligent Vehicles Symposium (IV). Nagoya: IEEE: 502-509
  7. 7.
    Cordts M, Omran M, Ramos S, Rehfeld T, Enzweiler M, Benenson R, Franke U, Roth S and Schiele B. 2016. The cityscapes dataset for semantic urban scene understanding//2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Las Vegas: IEEE: 3213-3223
  8. 8.
    Davison G, Ferris D, Pearson A and Shach R. 2020. Investments with returns: a systematic literature review of health-focused housing interventions. Journal of Housing and the Built Environment, 35(3): 829-845
  9. 9.
    Fu Y C, Guo B Y, Wang M and Qin X L. 2022. Spatial resilience evolution of green space from the perspective of social-ecological system adaptive governance: a case study for urban renewal in Guangzhou, China. Journal of Natural Resources, 37(8): 2118-2136
  10. 10.
    Goel R, Garcia L M T, Goodman A, Johnson R, Aldred R, Murugesan M, Brage S, Bhalla K and Woodcock J. 2018. Estimating city-level travel patterns using street imagery: a case study of using Google Street View in Britain. PLoS ONE, 13(5): e0196521
  11. 11.
    Gong P, Chen B, Li X C, Liu H, Wang J, Bai Y Q, Chen J M, Chen X, Fang L, Feng S L, Feng Y J, Gong Y L, Gu H, Huang H B, Huang X C, Jiao H Z, Kang Y D, Lei G B, Li A N, Li X T, Li X, Li Y C, Li Z L, Li Z D, Liu C, Liu C X, Liu M C, Liu S G, Mao W L, Miao C H, Ni H, Pan Q S, Qi S H, Ren Z H, Shan Z R, Shen S Q, Shi M J, Song Y M, Su M, Ping Suen H, Sun B, Sun F D, Sun J, Sun L, Sun W Y, Tian T, Tong X H, Tseng Y, Tu Y, Wang H, Wang L, Wang X, Wang Z M, Wu T H, Xie Y W, Yang J, Yang J, Yuan M, Yue W Z, Zeng H D, Zhang K, Zhang N, Zhang T, Zhang Y, Zhao F, Zheng Y C, Zhou Q M, Clinton N, Zhu Z L and Xu B. 2020. Mapping essential urban land use categories in China (EULUC-China): preliminary results for 2018. Science Bulletin, 65(3): 182-187
  12. 12.
    He K M, Gkioxari G, Dollár P and Girshick R. 2017. Mask R-CNN//2017 IEEE International Conference on Computer Vision (ICCV). Venice: IEEE: 2980-2988
  13. 13.
    Huang H M. 2013. The Characteristics of Urban Morphological Transformations and Development Mechanisms: A Case Study of Guangzhou Since 1949. Guangzhou: South China University of Technology (黄慧明. 2013. 1949年以来广州旧城的形态演变特征与机制研究. 广州: 华南理工大学)
  14. 14.
    Kingma D P and Ba J. 2017. Adam: a method for stochastic optimization. arXiv:1412.6980
  15. 15.
    Kirillov A, He K M, Girshick R, Rother C and Dollár P. 2019. Panoptic segmentation. arXiv:1801.00868
  16. 16.
    Lei Y J, Peng D, Zhang P P, Ke Q H and Li H F. 2021. Hierarchical paired channel fusion network for street scene change detection. IEEE Transactions on Image Processing, 30: 55-67
  17. 17.
    Liang C T, Jiang H, Yang S J, Tian P L, Ma X, Tang Z H, Wang H M and Wang W J. 2024. Characterizing street trees in three metropolises of central China by using Street View data: from individual trees to landscape mapping. Ecological Informatics, 80: 102480
  18. 18.
    Lin T Y, Dollár P, Girshick R, He K M, Hariharan B and Belongie S. 2017. Feature pyramid networks for object detection//2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Honolulu: IEEE: 936-944
  19. 19.
    Liu C and Song W X. 2024. Mapping property redevelopment via GeoAI: integrating computer vision and socioenvironmental patterns and processes. Cities, 144: 104644
  20. 20.
    Liu C T, Feng Q L, Liu J T, Wang Y, Shi T G, Li Y, Gong J H and Zhao H H. 2022. Urban green plastic cover extraction and spatial pattern changes in Jinan city based on DeepLabv3+ semantic segmentation model. National Remote Sensing Bulletin, 26(12): 2518-2530
  21. 21.
    Long Y and Liu L. 2017. How green are the streets? An analysis for central areas of Chinese cities using Tencent Street View. PLoS ONE, 12(2): e0171110
  22. 22.
    Loshchilov I and Hutter F. 2017. SGDR: stochastic gradient descent with warm restarts. arXiv:1608.03983
  23. 23.
    Ma X Y, Ma C Y, Wu C, Xi Y L, Yang R F, Peng N Y Z, Zhang C and Ren F. 2021. Measuring human perceptions of streetscapes to better inform urban renewal: a perspective of scene semantic parsing. Cities, 110: 103086
  24. 24.
    Miao C P, Yu S, Hu Y M, Zhang H W, He X Y and Chen W. 2020. Review of methods used to estimate the sky view factor in urban street canyons. Building and Environment, 168: 106497
  25. 25.
    Orhan S. 2022. Semantic Segmentation of Panoramic Images and Panoramic Image Based Outdoor Visual Localization. Turkey: Izmir Institute of Technology (Turkey)
  26. 26.
    Radke R J, Andra S, Al-Kofahi O and Roysam B. 2005. Image change detection algorithms: a systematic survey. IEEE Transactions on Image Processing, 14(3): 294-307
  27. 27.
    Ravi N, Gabeur V, Hu Y T, Hu R H, Ryali C, Ma T Y, Khedr H, Rädle R, Rolland C, Gustafson L, Mintun E, Pan J T, Alwala K V, Carion N, Wu C Y, Girshick R, Dollár P and Feichtenhofer C. 2024. SAM 2: segment anything in images and videos. arXiv:2408.00714
  28. 28.
    Ronneberger O, Fischer P and Brox T. 2015. U-Net: convolutional networks for biomedical image segmentation. arXiv:1505.04597
  29. 29.
    Sakurada K, Shibuya M and Wang W M. 2020. Weakly supervised silhouette-based semantic scene change detection//2020 IEEE International Conference on Robotics and Automation (ICRA). Paris: IEEE: 6861-6867
  30. 30.
    Sakurada K, Wang W M, Kawaguchi N and Nakamura R. 2017. Dense optical flow based change detection network robust to difference of camera viewpoints. arXiv:1712.02941
  31. 31.
    Sampson R J. 2017. Urban sustainability in an age of enduring inequalities: advancing theory and ecometrics for the 21st-century city. Proceedings of the National Academy of Sciences of the United States of America, 114(34): 8957-8962
  32. 32.
    Shelhamer E, Long J and Darrell T. 2017. Fully convolutional networks for semantic segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 39(4): 640-651
  33. 33.
    Simonyan K and Zisserman A. 2015. Very deep convolutional networks for large-scale image recognition. arXiv:1409.1556
  34. 34.
    Szegedy C, Liu W, Jia Y Q, Sermanet P, Reed S, Anguelov D, Erhan D, Vanhoucke V and Rabinovich A. 2014. Going deeper with convolutions. arXiv:1409.4842
  35. 35.
    Varghese A, Gubbi J, Ramaswamy A and Balamuralidhar P. 2019. ChangeNet: a deep learning architecture for visual change detection//Computer Vision - ECCV 2018 Workshops. Munich: Springer: 129-145
  36. 36.
    Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez A N, Kaiser L and Polosukhin I. 2023. Attention is all you need. arXiv:1706.03762
  37. 37.
    Wang G H, Gao B B and Wang C J. 2023. How to reduce change detection to semantic segmentation. Pattern Recognition, 138: 109384
  38. 38.
    Wang X L and Bao Y H. 1999. Study on the methods of land use dynamic change research. Progress in Geography, 18(1): 81-87
  39. 39.
    Xie E Z, Wang W H, Yu Z D, Anandkumar A, Alvarez J M and Luo P. 2021. SegFormer: simple and efficient design for semantic segmentation with transformers. arXiv:2105.15203
  40. 40.
    Yao Z H and Tian L. 2017. Transition of pattern and modes of governance for urban renewal in Guangzhou since the 21st century. Shanghai Urban Planning Review, (5): 29-34
  41. 41.
    Yin L and Wang Z X. 2016. Measuring visual enclosure for street walkability: using machine learning algorithms and Google Street View imagery. Applied Geography, 76: 147-153
  42. 42.
    Yue Z C, Lo C Y, Wu R, Ma L Y and Sham C W. 2024. Urban aquatic scene expansion for semantic segmentation in cityscapes. Urban Science, 8(2): 23
  43. 43.
    Zhang F and Liu Y. 2021. Street view imagery: methods and applications based on artificial intelligence. National Remote Sensing Bulletin, 25(5): 1043-1054
  44. 44.
    Zhang F, Wu L, Zhu D and Liu Y. 2019. Social sensing from street-level imagery: a case study in learning spatio-temporal urban mobility patterns. ISPRS Journal of Photogrammetry and Remote Sensing, 153: 48-58
  45. 45.
    Zhao T, Zhang S C, He X N, Xue B W and Zha F K. 2024. Improved DeepLabV3+ model for landslide identification in high-resolution remote sensing images after earthquakes. National Remote Sensing Bulletin, 28(9): 2293-2305

더 읽기

The above content is generated by Large Model Translation. The translated content is for reference only. We do not assume any commercial or legal responsibilty for any consequences arising from the use of our website