Journal of Jilin University(Earth Science Edition) ›› 2021, Vol. 51 ›› Issue (6): 1932-1938.doi: 10.13278/j.cnki.jjuese.20200159

Previous Articles    

Remote Sensing Image Change Detection Based on Random Patches and DeepLabV3+ Network

Wang Minshui1,2, Kong Xiangming3, Chen Xueye1,4, Yang Guodong1,2, Wang Mingchang1,2, Zhang Haiming2   

  1. 1. Key Laboratory of Urban Land Resources Monitoring and Simulation, Ministry of Natural Resources, Shenzhen 518000, Guangdong, China;
    2. College of GeoExploration Science and Technology, Jilin University, Changchun 130026, China;
    3. Shandong Institute of Geophysical & Geochemical Exploration, Jinan 250013, China;
    4. Shenzhen Research Center of Digital City Engineering, Shenzhen 518034, Guangdong, China
  • Received:2020-07-08 Online:2021-11-26 Published:2021-11-24
  • Supported by:
    Supported by the Open Fund of Key Laboratory of Urban Land Resources Monitoring and Simulation, Ministry of Natural Resources (KF-2019-04-080), the Key Laboratory of Land Subsidence Monitoring and Prevention, Ministry of Natural Resources (KLLSMP201901), the Scientific Research Project of the 13th Five-Year Plan of Jilin Province Education Department (JJKH20200999KJ) and the National Natural Science Foundation of China(42171407)

Abstract: In order to effectively preprocess the traditional remote sensing image change detection, we proposed a change detection method of building remote sensing image based on random patches and DeeplabV3+. This method builds a DeepLabV3+ semantic segmentation network based on the ResNet50, which is a feature extraction network, crops the random patches of 224 pixels×224 pixels in the image and label them as the network input to train the building extraction network,and then, modify the input layer of the building extraction network to six channels. The two-phase remote sensing images are converted into a 6-channel non-RGB image through matrix operation, which are used for network training and validating the change detection accuracy. In Experiment 1, the Mahalanobis distance classification method was used to detect the change by ENVI5.3 software. In Experiment 2, the improved U-Net network and random patches were used to complete the network training and accuracy verification. Experiment 3 used the training data and verification data of Experiment 2, and used random patches and DeepLabV3+ network to train the change detection network and verify the accuracy.The results of Experiment 1, 2, and 3 show that the average intersection-over-union of this method is 24.43%, 83.14%, and 89.90% respectively, and the boundary matching score is 61.47%, 80.24%, and 96.51% respectively.

Key words: random patches, DeepLabV3+network, semantic segmentation, building change detection

CLC Number: 

  • TP79
[1] 李亮,舒宁,王凯,等. 融合多特征的遥感影像变化检测方法[J]. 测绘学报,2014, 43(9):945-953, 959. Li Liang, Shu Ning, Wang Kai, et al. Change Detection Method for Remote Sensing Images Based on Multi-Features Fusion[J]. Acta Geodaetica Cartographica Sinica, 2014, 43(9):945-953, 959.
[2] 眭海刚,冯文卿,李文卓,等.多时相遥感影像变化检测方法综述[J].武汉大学学报(信息科学版),2018,43(12):1885-1898. Sui Haigang, Feng Wenqing, Li Wenzhuo, et al. Review of Change Detection Methods for Multi-Temporal Remote Sensing Imagery[J]. Geomatics and Information Science of Wuhan University, 2018, 43(12):1885-1898.
[3] 王明常,牛雪峰,杨毅恒,等.长白山地区景观格局过程模拟预测研究[J].吉林大学学报(地球科学版),2009, 39(5):947-952. Wang Mingchang, Niu Xuefeng, Yang Yiheng, et al. Simulation and Predicted Research on Changbai Mountain Landscape Pattern Process[J]. Journal of Jilin University (Earth Science Edition), 2009, 39(5):947-952.
[4] 王明常,郭鑫,王凤艳,等.基于FLUS的长春市土地利用动态变化与预测分析[J].吉林大学学报(地球科学版),2019, 39(6):1795-1804. Wang Mingchang, Guo Xin, Wang Fengyan, et al. Dynamic Change and Predictive Analysis Changchun City Based on FLUS Model[J]. Journal of Jilin University (Earth Science Edition), 2019, 39(6):1795-1804.
[5] 范荣双,陈洋,徐启恒,等.基于深度学习的高分辨率遥感影像建筑物提取方法[J].测绘学报,2019, 48(1):34-41. Fan Rongshuang, Chen Yang, Xu Qiheng, et al. A High-Resolution Remote Sensing Image Building Extraction Method Based on Deep Learning[J]. Acta Geodaetica Cartographica Sinica, 2019, 48(1):34-41.
[6] Kemker R, Salvaggio C, Kanan C. Algorithms for Semantic Segmentation of Multispectral Remote Sensing Imagery Using Deep Learning[J]. ISPRS Journal of Photogrammetry and Remote Sensing, 2018, 145(11):60-77.
[7] Zhao J, Gong M, Liu J, et al. Deep Learning to Classify Difference Image for Image Change Detection[C]//International Joint Conference on Neural Networks.[S. l.]:IEEE, 2014:411-417.
[8] Zhan Y, Fu K, Yan M, et al. Change Detection Based on Deep Siamese Convolutional Network for Optical Aerial Images[J]. IEEE Geoence and Remote Sensing Letters, 2017, 14(10):1845-1849.
[9] 袁立,袁吉收,张德政.基于DeepLab-V3+的遥感影像分类[J].激光与光电子学进展,2019,56(15):236-243. Yuan Li, Yuan Jishou, Zhang Dezheng. Remote Sensing Image Classification Based on DeepLab-V3+[J]. Laser & Optoelectronics Progress, 2019, 56(15):236-243.
[10] 朱春宇,王明常,王凤艳,等.基于深度置信网络与数学形态学融合的遥感影像建筑物变化检测[J].科学技术与工程,2020, 20(8):3157-3163. Zhu Chunyu, Wang Mingchang, Wang Fengyan, et al. Building Change Detection Based on Deep Belief Networks and Mathematical Morphology Fusion[J].Science Technology and Engineering, 2020, 20(8):3157-3163.
[11] Wang Mingchang, Zhang Haiming, Sun Weiwei, et al. A Coarse-to-Fine Deep Learning Based Land Use Change Detection Method for High-Resolution Remote Sensing Images[J]. Remote Sensing, 2020, 12(12):1933.
[12] He K, Zhang X, Ren S, et al. Deep Residual Learning for Image Recognition[C]//IEEE Conference on Computer Vision & Pattern Recognition.[S. l.]:IEEE Computer Society, 2016:770-778.
[13] Long J, Shelhamer E, Darrell T. Fully Convolutional Networks for Semantic Segmentation[J]. Transactions on Pattern Analysis & Machine Intelligence, 2014, 39(4):640-651.
[14] Yang L, Wang H, Yan K. Building Extraction of Multi-Source Data Based on Deep Learning[C]//2019 IEEE 4th International Conference on Image. Xiamen:Vision and Computing (ICIVC), 2019:296-300.
[15] Emmanuel Maggiori, Yuliya Tarabalka, Guillaume Charpiat, et al. "Can Semantic Labeling Methods Generalize to Any City? The Inria Aerial Image Labeling Benchmark"[C]//IEEE International Geoscience and Remote Sensing Symposium. Fort Worth:IEEE International Symposium on Geoscience and Remote Sensing (IGARSS), 2017:3226-3229.
[16] Ji Shunping, Wei Shiqing, Lu Meng. Fully Convolutional Networks for Multi-Source Building Extraction from an Open Aerial and Satellite Imagery Data Set[J]. IEEE Transactions on Geoscience and Remote Sensing, 2019, 57(1):574-586.
[1] Niu Ying, Zhao Xinyi, Zhou Yunxuan, Tian Bo, Wang Lihua. Sea Surface Salinity Spatio-Temporal Differentiation in Yangtze Estuarine Waters Using MODIS [J]. Journal of Jilin University(Earth Science Edition), 2019, 49(5): 1486-1495.
[2] Li Gang, Sun Guihua, Yao Yongjian, Zhu Boqin, Zhang Yaoming. Spatio-Temporal Evolution of the Sansha Bay Coastline [J]. Journal of Jilin University(Earth Science Edition), 2019, 49(1): 196-205.
[3] He Mengying, Mei Xi, Zhang Xunhua, Liu Jian, Guo Xingwei, Zheng Hongbo. Provenance Discrimination of Detrital Zircon U-Pb Dating in the Core CSDP-1 in the Continental Shelf of South Yellow Sea [J]. Journal of Jilin University(Earth Science Edition), 2019, 49(1): 85-95.
[4] Xiong Kai, Gong Zhaoning, Zhang Lei, Zhao Wenji. Spatial Distribution of Total Soil Nitrogen Under Reclaimed Water Recharge [J]. Journal of Jilin University(Earth Science Edition), 2017, 47(6): 1829-1837.
[5] Chen Shengbo, Yu Yafeng, Yang Jinzhong, Wang Nan, Meng Hua. Lithologic Information Extraction from ASTER Remote Sensing Data Based on Spectral Ratio Method [J]. Journal of Jilin University(Earth Science Edition), 2016, 46(3): 938-944.
[6] Huang Shaolin, Xu Hanqiu, Wang Lin. Influence of Calibration Parameter File (CPF) to Radiometric Correction on Landsat TM/ETM+ [J]. Journal of Jilin University(Earth Science Edition), 2014, 44(4): 1382-1387.
[7] Wang Mingchang, Niu Xuefeng, Chen Shengbo, Wang Ya’nan, Wang Zijun. DART Model-Based Inversion of Leaf Area Index from PROBA/CHRIS Data [J]. Journal of Jilin University(Earth Science Edition), 2013, 43(3): 1033-1039.
[8] Cui Hanwen, Jiang Qigang, Xing Yu, Xu Chi, Lin Nan. Dynamics of Sandy Desertification Under Climate Disturbance in China from 1975 to 2007 [J]. Journal of Jilin University(Earth Science Edition), 2013, 43(2): 582-591.
[9] Chen Yong, He Zongfa, Li Bing, Zhao Baocheng. Spatial Distribution of Tidal Creeks and Quantitative Analysis of Its Driving Factors in Chongming Dongtan,Shanghai [J]. Journal of Jilin University(Earth Science Edition), 2013, 43(1): 212-219.
[10] Chen Sheng-bo,Liu Yan-li,Yang Qian,Zhou Chao,Zhao Liang. Lithologic Classification from Hyperspectral Data in Dense Vegetation Cover Area [J]. Journal of Jilin University(Earth Science Edition), 2012, 42(6): 1959-1965.
[11] YANG Jia-jia, JIANG Qi-gang, ZHAO Jing, XU Yan, MENG Xiang-chong. Standard Mineral Quantitative Calculation Based on the Improved SVM and Hyperspectral Remote Sensing [J]. J4, 2012, 42(3): 864-871.
[12] CHEN Yong-liang, LI Xue-bin, LIN Nan. A Method for Extracting Anomalous Pixels of Remotely Sensed Data [J]. J4, 2012, 42(3): 881-886.
[13] WANG Li-hua, ZHOU Yun-xuan, TIAN Bo. Detecting Coral Reefs at Dongsha Atoll Using Landsat TM and ETM+Images [J]. J4, 2011, 41(5): 1630-1637.
[14] HE Jin-xin, Jonathan Li, YAN Hao-wen. An Architecture of Geospatial Sensor Network for Water Quality Monitoring [J]. J4, 2011, 41(4): 1262-1266.
[15] LI Hua-peng, ZHANG Shu-qing, SUN Yan, LIU Chun-yue. Wetland Classification Using Evidential Reasoning Approach with Multi-Temporal Landsat ETM+Imagery [J]. J4, 2011, 41(4): 1246-1252.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
[1] CHENG Li-ren, ZHANG Yu-jie, ZHANG Yi-chun. Ordovician Nautiloid Fossils of Xainza Region,Tibet[J]. J4, 2005, 35(03): 273 -0282 .
[2] LI Bing-cheng. Preliminary Studies on Holocene Climatic In Fuping,Shaanxi Province[J]. J4, 2005, 35(03): 291 -0295 .
[3] HE Zhong-hua,YANG De-ming,WANG Tian-wu,ZHENG Chang-qing. SHRIMP U[CD*2]Pb Dating of Zircons from Two-Mica Granite in Baga Area in Gangdise Belt[J]. J4, 2005, 35(03): 302 -0307 .
[4] CHEN Li, NIE Lei, WANG Xiu-fan, LI Jin. Seismic Risk Analysis of Some Electric Power Equipment Station in Suizhong[J]. J4, 2005, 35(05): 641 -645 .
[5] JI Hong-jin,SUN Feng-yue2,CHEN Man,HU Da-qian,SHI Yan-xiang,PAN Xiang-qing. Geochemical Evaluation for Uncovered GoldBearing Structures in Jiaodong Area[J]. J4, 2005, 35(03): 308 -0312 .
[6] CHU Feng-you, SUN Guo-sheng,LI Xiao-min,MA Wei-lin, ZHAO Hong-qiao. The Growth Habit and Controlling Factors of the CobaltRich Crusts in Seamount of the Central Pacific[J]. J4, 2005, 35(03): 320 -0325 .
[7] LI Bin, MENG Zi-fang, LI Xiang-bo, LU Hong-xuan, ZHENG Min. The Structural Features and Depositional Systems of the Early Tertiary in the Biyang Depression[J]. J4, 2005, 35(03): 332 -0339 .
[8] LI Tao, WU Sheng-jun, CAI Shu-ming, XUE Huai-ping, YASUNORI Nakayama. Simulation Analysis of the Storage Capacity Based on DEM Before and After Connecting to Yangtze River in Zhangdu Lake[J]. J4, 2005, 35(03): 351 -0355 .
[9] KUANG Li-xiong,GUO Jian-hua, MEI Lian-fu, TONG Xiao-lan, YANG Li. Study on the Upheaval of the Bogeda Mountain Block from Angle of Oil and Gas Exploration[J]. J4, 2005, 35(03): 346 -0350 .
[10] ZHANG Guang-xin, DENG Wei, HE Yan, RAMSIS Salama. An Application of Hydrological Response Units in Assessment of Soil Salinization Risks[J]. J4, 2005, 35(03): 356 -0360 .