Journal of Jilin University(Earth Science Edition) ›› 2021, Vol. 51 ›› Issue (6): 1932-1938.doi: 10.13278/j.cnki.jjuese.20200159

Previous Articles    

Remote Sensing Image Change Detection Based on Random Patches and DeepLabV3+ Network

Wang Minshui1,2, Kong Xiangming3, Chen Xueye1,4, Yang Guodong1,2, Wang Mingchang1,2, Zhang Haiming2   

  1. 1. Key Laboratory of Urban Land Resources Monitoring and Simulation, Ministry of Natural Resources, Shenzhen 518000, Guangdong, China;
    2. College of GeoExploration Science and Technology, Jilin University, Changchun 130026, China;
    3. Shandong Institute of Geophysical & Geochemical Exploration, Jinan 250013, China;
    4. Shenzhen Research Center of Digital City Engineering, Shenzhen 518034, Guangdong, China
  • Received:2020-07-08 Online:2021-11-26 Published:2021-11-24
  • Supported by:
    Supported by the Open Fund of Key Laboratory of Urban Land Resources Monitoring and Simulation, Ministry of Natural Resources (KF-2019-04-080), the Key Laboratory of Land Subsidence Monitoring and Prevention, Ministry of Natural Resources (KLLSMP201901), the Scientific Research Project of the 13th Five-Year Plan of Jilin Province Education Department (JJKH20200999KJ) and the National Natural Science Foundation of China(42171407)

Abstract: In order to effectively preprocess the traditional remote sensing image change detection, we proposed a change detection method of building remote sensing image based on random patches and DeeplabV3+. This method builds a DeepLabV3+ semantic segmentation network based on the ResNet50, which is a feature extraction network, crops the random patches of 224 pixels×224 pixels in the image and label them as the network input to train the building extraction network,and then, modify the input layer of the building extraction network to six channels. The two-phase remote sensing images are converted into a 6-channel non-RGB image through matrix operation, which are used for network training and validating the change detection accuracy. In Experiment 1, the Mahalanobis distance classification method was used to detect the change by ENVI5.3 software. In Experiment 2, the improved U-Net network and random patches were used to complete the network training and accuracy verification. Experiment 3 used the training data and verification data of Experiment 2, and used random patches and DeepLabV3+ network to train the change detection network and verify the accuracy.The results of Experiment 1, 2, and 3 show that the average intersection-over-union of this method is 24.43%, 83.14%, and 89.90% respectively, and the boundary matching score is 61.47%, 80.24%, and 96.51% respectively.

Key words: random patches, DeepLabV3+network, semantic segmentation, building change detection

CLC Number: 

  • TP79
[1] 李亮,舒宁,王凯,等. 融合多特征的遥感影像变化检测方法[J]. 测绘学报,2014, 43(9):945-953, 959. Li Liang, Shu Ning, Wang Kai, et al. Change Detection Method for Remote Sensing Images Based on Multi-Features Fusion[J]. Acta Geodaetica Cartographica Sinica, 2014, 43(9):945-953, 959.
[2] 眭海刚,冯文卿,李文卓,等.多时相遥感影像变化检测方法综述[J].武汉大学学报(信息科学版),2018,43(12):1885-1898. Sui Haigang, Feng Wenqing, Li Wenzhuo, et al. Review of Change Detection Methods for Multi-Temporal Remote Sensing Imagery[J]. Geomatics and Information Science of Wuhan University, 2018, 43(12):1885-1898.
[3] 王明常,牛雪峰,杨毅恒,等.长白山地区景观格局过程模拟预测研究[J].吉林大学学报(地球科学版),2009, 39(5):947-952. Wang Mingchang, Niu Xuefeng, Yang Yiheng, et al. Simulation and Predicted Research on Changbai Mountain Landscape Pattern Process[J]. Journal of Jilin University (Earth Science Edition), 2009, 39(5):947-952.
[4] 王明常,郭鑫,王凤艳,等.基于FLUS的长春市土地利用动态变化与预测分析[J].吉林大学学报(地球科学版),2019, 39(6):1795-1804. Wang Mingchang, Guo Xin, Wang Fengyan, et al. Dynamic Change and Predictive Analysis Changchun City Based on FLUS Model[J]. Journal of Jilin University (Earth Science Edition), 2019, 39(6):1795-1804.
[5] 范荣双,陈洋,徐启恒,等.基于深度学习的高分辨率遥感影像建筑物提取方法[J].测绘学报,2019, 48(1):34-41. Fan Rongshuang, Chen Yang, Xu Qiheng, et al. A High-Resolution Remote Sensing Image Building Extraction Method Based on Deep Learning[J]. Acta Geodaetica Cartographica Sinica, 2019, 48(1):34-41.
[6] Kemker R, Salvaggio C, Kanan C. Algorithms for Semantic Segmentation of Multispectral Remote Sensing Imagery Using Deep Learning[J]. ISPRS Journal of Photogrammetry and Remote Sensing, 2018, 145(11):60-77.
[7] Zhao J, Gong M, Liu J, et al. Deep Learning to Classify Difference Image for Image Change Detection[C]//International Joint Conference on Neural Networks.[S. l.]:IEEE, 2014:411-417.
[8] Zhan Y, Fu K, Yan M, et al. Change Detection Based on Deep Siamese Convolutional Network for Optical Aerial Images[J]. IEEE Geoence and Remote Sensing Letters, 2017, 14(10):1845-1849.
[9] 袁立,袁吉收,张德政.基于DeepLab-V3+的遥感影像分类[J].激光与光电子学进展,2019,56(15):236-243. Yuan Li, Yuan Jishou, Zhang Dezheng. Remote Sensing Image Classification Based on DeepLab-V3+[J]. Laser & Optoelectronics Progress, 2019, 56(15):236-243.
[10] 朱春宇,王明常,王凤艳,等.基于深度置信网络与数学形态学融合的遥感影像建筑物变化检测[J].科学技术与工程,2020, 20(8):3157-3163. Zhu Chunyu, Wang Mingchang, Wang Fengyan, et al. Building Change Detection Based on Deep Belief Networks and Mathematical Morphology Fusion[J].Science Technology and Engineering, 2020, 20(8):3157-3163.
[11] Wang Mingchang, Zhang Haiming, Sun Weiwei, et al. A Coarse-to-Fine Deep Learning Based Land Use Change Detection Method for High-Resolution Remote Sensing Images[J]. Remote Sensing, 2020, 12(12):1933.
[12] He K, Zhang X, Ren S, et al. Deep Residual Learning for Image Recognition[C]//IEEE Conference on Computer Vision & Pattern Recognition.[S. l.]:IEEE Computer Society, 2016:770-778.
[13] Long J, Shelhamer E, Darrell T. Fully Convolutional Networks for Semantic Segmentation[J]. Transactions on Pattern Analysis & Machine Intelligence, 2014, 39(4):640-651.
[14] Yang L, Wang H, Yan K. Building Extraction of Multi-Source Data Based on Deep Learning[C]//2019 IEEE 4th International Conference on Image. Xiamen:Vision and Computing (ICIVC), 2019:296-300.
[15] Emmanuel Maggiori, Yuliya Tarabalka, Guillaume Charpiat, et al. "Can Semantic Labeling Methods Generalize to Any City? The Inria Aerial Image Labeling Benchmark"[C]//IEEE International Geoscience and Remote Sensing Symposium. Fort Worth:IEEE International Symposium on Geoscience and Remote Sensing (IGARSS), 2017:3226-3229.
[16] Ji Shunping, Wei Shiqing, Lu Meng. Fully Convolutional Networks for Multi-Source Building Extraction from an Open Aerial and Satellite Imagery Data Set[J]. IEEE Transactions on Geoscience and Remote Sensing, 2019, 57(1):574-586.
[1] Feng Yuanyuan, Li Chaokui, Liu Songhuan, Tian Qin. SSC-SeNet: A Semantic Segmentation Algorithm for Buildings in Surface Mining Areas by Fusing Point Cloud and Image Data [J]. Journal of Jilin University(Earth Science Edition), 2025, 55(5): 1757-1773.
[2] Shan Huilin, Wang Xingtao, Xu Yijun, Wang Zhihao, Huang Haohan, Zhang Yinsheng. A Three-Dimensional Fault Seismic Recognition Method Based on Lightweight Fusion Semantic Segmentation [J]. Journal of Jilin University(Earth Science Edition), 2025, 55(3): 987-1000.
[3] Wang Minshui, Wang Mingchang, Wang Jingyu, Liu Ziwei. Remote Sensing Image Classification Based on Fusion of Attention Mechanism and Weight Balance Algorithm [J]. Journal of Jilin University(Earth Science Edition), 2025, 55(2): 697-704.
[4] Gao Kangzhe, Wang Fengyan, Liu Ziwei, Wang Mingchang. Semantic Segmentation of Remote Sensing Images Based on Improved U-Net [J]. Journal of Jilin University(Earth Science Edition), 2024, 54(5): 1752-1763.
[5] Wang Wei, Xiong Yizhou, Wang Xin. NHNet: A Novel Hierarchical Semantic Segmentation Network for Remote Sensing Images [J]. Journal of Jilin University(Earth Science Edition), 2024, 54(5): 1764-1772.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
[1] YU Ping, LI Rui-lei, FU Lei, HAO Xue, ZHANG Xiang-jun,LIAN Guo-fen. Regional Tectonic Characteristics and Significance of North Harbin Area in Songliao Basin: Evidenced from Long Seismic Profiles[J]. J4, 2005, 35(05): 611 -615 .
[2] ZHANG Yuan-qing, SONG Bing-zhong, WANG Yu-fu, ZHANG Ning. Metallogenetic Rules and Prediction of Gold Deposits Around Tongshi Complex,Western Shandong Province[J]. J4, 2010, 40(6): 1287 -1294 .
[3] LI Jian-ping, LI Tong-lin, ZHANG Hui, XU Kai-jun. Study and Application of the TEM Forward and Inversion Problem of Irregular Loop Source over the Layered Medium[J]. J4, 2005, 35(06): 790 -0795 .
[4] GAO Song,SONG Ying,WANG Lin,JIANG Buxin. Study on the Screening and Characterization of Special Effective Bacteria of Degrading Thiuram in the Waterbody[J]. J4, 2006, 36(03): 455 -457 .
[5] ZHANG Feng-jun, LI Qing, MA Jiu-tong, YU Guang-ju. Experimental Study on Treatment of Furfural Wastewater with Membrane Distillation[J]. J4, 2006, 36(02): 270 -0273 .
[6] LU Shuang-fang, LI Ji-jun, XUE Hai-tao, XU Li-heng. Chemical Kinetics of Carbon Isotope Fractionation of Oil-Cracking Methane and Its Initial Application[J]. J4, 2006, 36(05): 825 -829 .
[7] DING Zhi-hong,FENG Ping,MAO Hui-hui. Research and Application of a Method Considering Runoff Distribution Through A Year During Partitioning Runoff into Abundant and Low State[J]. J4, 2009, 39(2): 276 -0280 .
[8] REN He-jun, LIU Na, GAO Song,ZHANG Lan-ying,ZHANG Yu-ling,ZHOU Rui. Degradation of Polychlorinated Biphenyls and Confirm of bphA1 Gene Core by Pseudomonas DN2[J]. J4, 2009, 39(2): 312 -0316 .
[9] Huang Qibo, Qin Xiaoqun, Liu Pengyu, Kang Zhiqiang, Tang Pingping. Applicability of Karst Carbon Sinks Calculation Methods in Semi-Arid Climate Environment[J]. Journal of Jilin University(Earth Science Edition), 2015, 45(1): 240 -246 .
[10] Xiong Xiaoliang,Sun Hongyue,Zhang Shihua,Cai Yueliang. Analysis of Condition of Ensuring High-Lift Siphon Drainage and Numerical Simulation of Choice of Optimum Diameter[J]. Journal of Jilin University(Earth Science Edition), 2014, 44(5): 1595 -1601 .