吉林大学学报(地球科学版) ›› 2021, Vol. 51 ›› Issue (1): 296-306.doi: 10.13278/j.cnki.jjuese.20190321

• 地球探测与信息技术 • 上一篇    

基于FPN Res-Unet的高分辨率遥感影像建筑物变化检测

王明常1,2, 朱春宇1, 陈学业2, 王凤艳1, 李婷婷1, 张海明1, 韩有文3   

  1. 1. 吉林大学地球探测科学与技术学院, 长春 130026;
    2. 自然资源部城市国土资源监测与仿真重点实验室, 广东 深圳 518000;
    3. 青海省遥感测绘院, 西宁 810001
  • 收稿日期:2019-12-30 发布日期:2021-02-02
  • 通讯作者: 陈学业(1971-),男,教授级高工,主要从事数字城市相关方面的研究,E-mail:446487869@qq.com E-mail:446487869@qq.com
  • 作者简介:王明常(1975-),男,教授,博士,主要从事遥感与地理信息系统方面的教学研究,E-mail:wangmc@jlu.edu.cn
  • 基金资助:
    国家自然科学基金项目（41430322）；自然资源部城市国土资源监测与仿真重点实验室开放基金资助课题（KF-2018-03-020，KF-2019-04-080）；吉林省教育厅“十三五”科学研究规划项目（JJKH20200999KJ）；自然资源部地面沉降监测与防治重点实验室开放基金项目（KLLSMP201901）

Building Change Detectionin High Resolution Remote Sensing Images Based on FPN Res-Unet

Wang Mingchang1,2, Zhu Chunyu1, Chen Xueye2, Wang Fengyan1, Li Tingting1, Zhang Haiming1, Han Youwen3   

  1. 1. College of GeoExploration Science and Technology, Jilin University, Changchun 130026, China;
    2. Key Laboratory of Urban Land Resources Monitoring and Simulation, MNR, Shenzhen 518000, Guangdong, China;
    3. Institute of Remote Sensing and Surveying and Mapping Qinghai, Xining 810001, China
  • Received:2019-12-30 Published:2021-02-02
  • Supported by:
    Supported by the National Natural Science Foundation of China(41430322),the Project Supported by the Open Fund of Key Laboratory of Urban Land Resources Monitoring and Simulation, MNR(KF-2018-03-020,KF-2019-04-080),the Scientific Research Project of the 13th Five-Year Plan of Jilin Province Education Department(JJKH20200999KJ) and the Open Fund of Key Laboratory of Land Subsidence Monitoring and Prevention, Ministry of Natural Resources of China(KLLSMP201901)

PDF (PC)

474

摘要： 针对城市土地资源变化检测工作繁杂、工作量大、自动化程度低等问题，本文提出一种基于深度学习模型的高分辨率遥感影像建筑物变化检测方法，将语义分割的思想引入到遥感变化检测。基于残差结构特征较卷积层提取性能更优和特征金字塔网络多尺度预测的特点，将残差结构和特征金字塔网络融合到Unet模型中，建立FPN Res-Unet模型。该模型以Unet为基础，引入ResNet18的残差结构作为编码路径特征提取层，在每次卷积后使用边界填充，使得输入图像和输出图像尺寸一致；在解码路径每级上采样过程中，拓展支路径将特征金字塔网络融合到模型的网络主干中，将残差结构、Unet及特征金字塔网络的优点相互融合，增强了Unet的特征提取，弥补了语义分割网络对小目标检测的欠缺；在获取深层语义信息的同时关注细节信息，提高建筑物变化检测精度。实验表明，该方法在所用数据集，准确率、召回率、F1 3种指标均达到90%以上。

关键词: 遥感影像, 变化检测, ResNet18, Unet, 特征金字塔网络, FPN Res-Unet模型

Abstract: In view of the complexity, heavy workload,and low degree of automation in current survey of land resource change detection, a building change detection method of high-resolution remote sensing image based on deep learning model is proposed, and the idea of semantic segmentation is applied to change detection. Based on the better extraction performance of the residual structure than convolution layers and the characteristics of multi-scale prediction of feature pyramid networks, the residual structure and FPN are fused into Unet model to establish FPN Res-Unet. The model is based on Unet with ResNet residual structure as its feature extraction layer. After each convolution, padding is used to keep the size of the input image and the output image consistent. In the process of sampling at each level of the decoding path, the branch path is expanded to fuse FPN into the network trunk of the model. It fully combines the advantages of residual structure, Unet and FPN, which makes it pay attention to details while obtaining deep semantic information, and improves the detection accuracy of building change. Experiments show that the accuracy rate, recall rate and F1 of the method in the data set used reach more than 90%.

Key words: remote sensing image, change detection, ResNet18, Unet, FPN, FPN Res-Unet

中图分类号: 

  • P237
[1] Huang Xin, Zhang Liangpei, Zhu Tingting. Building Change Detection from Multitemporal High-Resolution Remotely Sensed Images Based on a Morphological Building Index[J]. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2014, 7(1):105-115.
[2] 孙晓霞,张继贤,燕琴,等.遥感影像变化检测方法综述及展望[J].遥感信息,2011(1):119-123. Sun Xiaoxia, Zhang Jixian, Yan Qin, et al. A Summary on Current Techniques and Prospects of Remote Sensing Change Detection[J]. Remote Sensing Information, 2011(1):119-123.
[3] 明冬萍,骆剑承,沈占锋,等.高分辨率遥感影像信息提取与目标识别技术研究[J].测绘科学,2005,30(3):18-20,3. Ming Dongping, Luo Jiancheng, Shen Zhanfeng, et al. Research on Information Extraction and Target Recognition from High Resolution Remote Sensing Image[J]. Science of Surveying and Mapping, 2005, 30(3):18-20,3.
[4] Wang M, Zhang X,Niu X, et al. Scene Classification of High-Resolution Remotely Sensed Image Based on ResNet[J]. Journal of Geovisualization and Spatial Analysis,2019,3:16. doi:10.1007/s41651-019-0039-9.
[5] 唐文博. 基于卷积神经网络的高分辨率多光谱遥感图像上的城区建筑物变化检测技术[D].杭州:浙江大学,2019. Tang Wenbo. Building Change Detection Technology Based on Convention Neural Network in High Resolution Multispectral Remote Sensing Images[D]. Hangzhou:Zhejiang University, 2019.
[6] 顾炼,许诗起,竺乐庆.基于FlowS-Unet的遥感图像建筑物变化检测[J].自动化学报,2020, 46(6):1291-1300. Gu Lian, Xu Shiqi, Zhu Leqing. Change Detection for Buildings in Remote Sensing Images Based on FlowS-Unet[J]. Acta Automatica Sinica, 2020, 46(6):1291-1300.
[7] Myint Soe Win, Lam Nina S N,Tyler John M. Wavelets for Urban Spatial Feature Discrimination[J]. Photogrammetric Engineering and Remote Sensing, 2004, 70(7):803-812.
[8] 宫鹏,黎夏,徐冰.高分辨率影像解译理论与应用方法中的一些研究问题[J].遥感学报,2006(1):1-5. Gong Peng, Li Xia, Xu Bing. Interpretation Theory and Application Method Development for Information Extraction from High Resolution Remotely Sensed Data[J]. Journal of Remote Sensing, 2006(1):1-5.
[9] 黄昕. 高分辨率遥感影像多尺度纹理、形状特征提取与面向对象分类研究[D].武汉:武汉大学,2009. Huang Xin. Multiscale Texture and Shape Feature Extraction and Object-Oriented Classification for Very High Resolution Remotely Sensed Imagery[D]. Wuhan:Wuhan University, 2009.
[10] 王明常,张馨月,张旭晴,等. 基于极限学习机的GF-2影像分类[J].吉林大学学报(地球科学版),2018,48(2):373-378. Wang Mingchang, Zhang Xinyue, Zhang Xuqing, et al. GF-2 Image Classification Based on Extreme Learning Machine[J]. Journal of Jilin University (Earth Science Edition), 2018,48(2):373-378.
[11] 杨磊.基于多特征Dempster-Shafe证据融合的高分辨率遥感影像建筑物变化检测[D].成都:西南交通大学,2016. Yang Lei. Building Change Detection from Multitemporal High Resolution Remote Sensing Imagery Based on Multi-Features Fusion Using Dempster-Shafer Evidence Theory[D]. Chengdu:Southwest Jiaotong University,2016.
[12] Bouziani M, Goita K, He Dongchen. Automatic Change Detection of Buildings in Urban Environment from Very High Spatial Resolution Images Using Existing Geodatabase and Prior Knowledge[J]. ISPRS Journal of Photogrammetry and Remote Sensing,2010, 65(1):143-153.
[13] Chini M, Pierdicca N, Emery W J. Exploiting SAR and VHR Optical Images to Quantify Damage Caused by the 2003 Bam Earthquake[J]. IEEE Transactions on Geoscience and Remote Sensing, 2009, 47(1):145-152.
[14] Cao Guo, Li Yupeng, Liu Yazhou, et al. Automatic Chang Detection in High-Resolution Remote-Sensing Images by Means of Level Set Evolution and Support Vector Machine Classification[J]. International Journal of Remote Sensing,2014,35(16):6255-6270.
[15] 丁海勇,罗麒杰,王晓英.基于形态学纹理特征的高分辨率遥感影像变化检测[J]. 测绘科学技术, 2017, 5(3):143-151. Ding Haiyong, Luo Qijie, Wang Xiaoying. High-Resolution Remote Sensing Image Change Detection Based on Morphological Texture Features[J]. Geomatics Science and Technology,2017,5(3):143-151.
[16] 刘波,燕琴,刘恒飞,等.一种正样本单分类框架下的高分辨率遥感影像建筑物变化检测算法[J].测绘工程, 2019,28(2):52-56. Liu Bo, Yan Qin, Liu Hengfei, et al. A New Building Change Detection Algorithm of High-Resolution Remote Sensing Image Based on One-Class Classifier Framework[J]. Engineering of Surveying and Mapping, 2019, 28(2):52-56.
[17] 季顺平,魏世清.遥感影像建筑物提取的卷积神经元网络与开源数据集方法[J].测绘学报,2019,48(4):448-459. Ji Shunping, Wei Shiqing. Building Extraction via Convolutional Neural Networks from an Open Remote Sensing Building Dataset[J]. Acta Geodaetica et Cartographica Sinica, 2019, 48(4):448-459.
[18] Ronneberger O, Fischer P, Brox T. U-Net:Convolutional Networks for Biomedical Image Segmentation[C]//International Conference on Medical Image Computing and Computer-Assisted Intervention. Cham:Springer Verlag, 2015:234-241.
[19] He Kaiming, Zhang Xiangyu, Ren Shaoqing, et al. Deep Residual Learning for Image Recognition[C]//Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Las Vegas:IEEE Computer Society, 2016:770-778.
[20] 马玥.基于多源遥感信息的湿地土地覆被分类研究[D].长春:吉林大学,2018. Ma Yue. Land Cover Classification of Wetland Based on Multi-Source Remote Sensing[D]. Changchun:Jilin University,2018.
[21] Lin T Y, Dollár P, Girshick R, et al. Feature Pyramid Networks for Object Detection[C]//30th IEEE Conference on Computer Vision and Pattern Recognition. United States:Institute of Electrical and Electronics Engineers, 2017:936-944.
[22] Glorot X, Bordes A, Bengio Y. Deep Sparse Rectifier Neural Networks[J]. Journal of Machine Learning Research,2011,15:315-323.
[23] Ioffe S, Szegedy C. Batch Normalization:Accelerating Deep Network Training by Reducing Internal Covariate Shift[C]//32nd International Conference on Machine Learning. Lile:International Machine Learning Society, 2015:448-456.
[24] 刘丹枫,刘建霞.面向深度学习过拟合问题的神经网络模型[J].湘潭大学自然科学学报,2018,40(2):96-99. Liu Danfeng, Liu Jianxia. A Neural Network Model for the Overfitting Problem in Deep Learning[J]. Natural Science Journal of Xiangtan University, 2018, 40(2):96-99.
[1] 张施跃, 束龙仓, 闵星, 胡慧杰, 邹志科. 基于土地利用类型的大气降水入渗补给量计算[J]. 吉林大学学报(地球科学版), 2017, 47(3): 860-867.
[2] 田波，周云轩，蒋云安，侯长谋. ASTER数据在深圳东部滨海地区土地利用调查中的应用[J]. J4, 2008, 38(1): 121-0128.
Viewed
Full text


Abstract

Cited
  Shared   
  Discussed   
No Suggested Reading articles found!
版权所有 © 《吉林大学学报(地球科学版)》编辑部
地址：长春市西民主大街938号(130026)　电话：+86-431-88502374；13756165364　E-mail: xuebao1956@jlu.edu.cn
本系统由北京玛格泰克科技发展有限公司设计开发