Journal of Jilin University(Engineering and Technology Edition) ›› 2020, Vol. 50 ›› Issue (5): 1778-1787.doi: 10.13229/j.cnki.jdxbgxb20190490

Previous Articles    

A new deep learning method for roads recognition from SAR images

Hua CHEN1,2,3(),Wei GUO1,2(),Jing-wen YAN4,Wen-hao ZHUO4,Liang-bin WU5   

  1. 1.Key Laboratory of Microwave Remote Sensing, Chinese Academy of Sciences, Beijing 0090, China
    2.National Space Science Center, Chinese Academy of Sciences, Beijing 100190, China
    3.Graduate School of University of Chinese Academy of Sciences, Beijing 100049, China
    4.College of Engineering, Shantou University, Shantou 515063, China
    5.Radar and Electronic Equipment Research Institute of China Aviation, Wuxi 214063, China
  • Received:2019-05-20 Online:2020-09-01 Published:2020-09-16
  • Contact: Wei GUO E-mail:e_chenhua@163.com;guowei@mirslab.cn

RICH HTML

 32   

PDF (PC)

499

Abstract:

Deep learning is an effective technical method to enhance the recognition accuracy of remote sensing image target. To solve the problem of the complicated steps in road recognition from Synthetic Aperture Radar(SAR) images, this paper proposes a SAR image road recognition method based on deep learning. First, based on the traditional Full Convolution Neural Network(FCNN), a New Convolution Neural Network(NCNN) is constructed by revising the activation function to effectively alleviate the loss of road information. Then, the NCNN is applied to road recognition experiments of simulated SAR images and real SAR images with self-constructed road label sets to improve the robustness of the proposed method. The experimental results show that the NCNN can be used to identify the overall characteristics of the road with higher accuracy and better reliability in comparison with the Support Vector Machine(SVM), traditional FCNN and other algorithms.

Key words: information processing technology, synthetic aperture radar image, roads recognition, deep learning, fully convolutional network, max feature map

CLC Number: 

  • TP391.4

Fig.1

Typical frame diagram of fully convolutional network model"

Fig.2

MFM-based convolution neural network framework"

Fig.3

M-FCN network layer algorithm flow chart"

Fig.4

Simulated SAR experimental data"

Fig.5

Comparison of road recognition results of various algorithms"

Table 1

Comparison on different method for road extraction from SAR image"

评价指标SVMFCNFCN-ReLUM-FCN
IoU41.760.567.669.4
ACC83.595.196.096.2

Fig.6

Optical road image labels and simulated SAR images"

Fig.7

SNR changes correspond to changes in accuracy of extracting SAR road features by M-FCN"

Table 2

Influence of SNR changes on accuracy of M-FCN in extracting road features"

SNRmIoUACC
0.259.095.4
0.362.195.7
0.463.795.7
0.563.995.8
0.664.795.9
0.765.295.8
0.866.296.0
0.969.496.3

Fig.8

Comparison of road recognition results of various algorithms from SAR images"

1 Bajcsy R, Tavakoli M. Computer recognition of roads from satellite pictures[J]. IEEE Transactions on Systems Man and Cybernetics, 1976, 6(9): 623-637.
2 张永宏, 何静, 阚希, 等. 遥感图像道路提取方法综述[J]. 计算机工程与应用, 2018, 54(13): 1-10.
Zhang Yong-hong, He Jin, Kan Xi, et al. Summary of road extraction methods for remote sensing images[J]. Computer Engineering and Applications, 2018, 54(13): 1-10.
3 Samadani R, Vesecky J F. Finding curvilinear features in speckled images[J]. IEEE Transactions on Geoscience and Remote Sensing, 1990, 28(4): 669-673.
4 Tupin F, Maitre H, Mangin J F, et al. Detection of linear features in SAR images: application to road network extraction[J]. IEEE Transactions on Geoscience and Remote Sensing, 1998, 36(2): 434-453.
5 Negri M, Gamba P, Lisini G, et al. Junction-aware extraction and regularization of urban road networks in high-resolution SAR images[J]. IEEE Transactions on Geoscience and Remote Sensing, 2006, 44(10): 2962-2971.
6 Lisini G, Tison C, Tupin F, et al. Feature fusion to improve road network extraction in high-resolution SAR images[J]. IEEE Geoscience and Remote Sensing Letters, 2006, 3(2): 217-221.
7 Lu P P, Du K N, Yu W D, et al. A new region growing-based method for road network extraction and its application on different resolution SAR images[J]. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2014, 7(12): 4772-4783.
8 Jin R, Zhou W, Yin J, et al. CFAR line detector for polarimetric SAR images using wilks’ test statistic[J]. IEEE Geoscience and Remote Sensing Letters, 2016, 13(5): 711-715.
9 Xiao F H, Chen Y, Tong L, et al. Road detection in high-resolution SAR images using duda and path operators[C]∥IEEE International Geoscience and Remote Sensing Symposium (IGARSS), Beijing, 2016: 1266-1269.
10 Wei Q R, Feng D Z. Extraction line feature in SAR images through image edge fields[J]. IEEE Geoscience and Remote Sensing Letters, 2016, 13(4): 540-544.
11 程江华, 高贵, 库锡树, 等. SAR 图像道路网提取方法综述[J]. 中国图象图形学报, 2013, 18(1): 11-23．
Cheng Jiang-hua, Gao Gui, Xi-shu Ku, et al. Review of road network extraction from SAR images[J]. Journal of Image and Graphics, 2013, 18(1): 11-23.
12 Tupin F, Houshmand B, Datcu M. Road detection in dense urban areas using SAR imagery and the usefulness of multiple views[J]. IEEE Transactions on Geoscience and Remote Sensing, 2002, 40(11): 2405-2414.
13 Jeon B K, Jang J H, Hong K S. Road detection in spaceborne SAR images using a genetic algorithm[J]. IEEE Transactions on Geoscience and Remote Sensing, 2002, 40(1): 22-29.
14 张广伟, 张永红. 基于链码优化的SAR 影像城市道路网络提取[J]. 遥感学报, 2008, 12(4): 620-625.
Zhang Guang-wei, Zhang Yong-hong. Road network extraction of urban areasin SAR image based on optimization of chain code[J]. Journal of Remote Sensing, 2008, 12(4): 620-625.
15 洪日昌, 吴秀清, 刘媛, 等. 低分辨率遥感影像中道路的全自动提取方法研究[J]. 遥感学报, 2008, 12(1): 36-45.
Hong Ri-chang, Wu Xiu-qing, Liu Yuan, et al. Research on roads automatic extraction from low resolution remote sensing image[J]. Journal of Remote Sensing, 2008, 12(1): 36-45.
16 Krizhevsky A, Sutskever I, Hinton G E. ImageNet classification with deep convolutional neural networks[C]∥International Conference on Neural Information Processing Systems, Curran Associates Inc., 2012: 1097-1105.
17 Simonyan K, Zisserman A. Very deep convolutional networks for large-scale image recognition[J]. Computer Vision and Pattern Recognition, ArXiv: 1409.1556, 2014.
18 Szegedy C, Liu W, Jia Y, et al. Going deeper with convolutions[C]∥IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, USA, 2015: 1-9.
19 He K, Zhang X, Ren S, et al. Deep residual learning for image recognition[C]∥IEEE Conference on Computer Vision and Pattern Recognition, LasVegas, 2016: 770-778.
20 Chen S Z, Wang H P, Xu F, et al. Target classification using the deep convolutional networks for SAR images[J]. IEEE Transactions on Geoscience and Remote Sensing, 2016, 54(8): 4806-4817.
21 Wang Y, Wang C, Zhang H. Combining a single shot multibox detector with transfer learning for ship detection using sentinel-1 SAR images[J]. Remote Sensing Letters, 2018, 9(8): 780-788.
22 Wang Y Y, Wang C, Zhang H, et al. Automatic ship detection based on retina net using multi-resolution Gaofen-3 imagery[J]. Remote Sensing, 2019, 11(5): 531.
23 Corentin H, Majid A S, Nina M. Road segmentation in SAR satellite images with deep fully convolutional neural networks[J]. IEEE Geoscience and Remote Sensing Letters, 2018, 15(12): 1867-1871.
24 Jonathan L, Evan S, Trevor D. Fully convolutional networks for semantic segmentation[C]∥IEEE Conference on Computer Vision and Pattern Recognition, Boston, 2015: 3431-3440.
25 Wu X, He R, Sun Z. A lightened CNN for deep face representation[J]. Computer Science,arXiv:1511.02683, 2015.
26 Cheng G, Wang Y, Xu S, et al. Automatic road detection and centerline extraction via cascaded end-to-end convolutional neural network[J]. IEEE Transactions on Geoscience & Remote Sensing, 2017, 55(6): 3322-3337.
[1] Zai-feng SHI,Jin-zhuo LI,Qing-jie CAO,Hui-long LI,Qi-xing HU. Low⁃dose spectral computer⁃tomography imaging denoising method via a generative adversarial network [J]. Journal of Jilin University(Engineering and Technology Edition), 2020, 50(5): 1755-1764.
[2] Ke-yan WANG,Di WANG,Xi ZHAO,Jing-yi CHEN,Yun-song LI. Image dehazing based on joint estimation via convolutional neural network [J]. Journal of Jilin University(Engineering and Technology Edition), 2020, 50(5): 1771-1777.
[3] Hong-wei ZHAO,Xiao-han LIU,Yuan ZHANG,Li-li FAN,Man-li LONG,Xue-bai ZANG. Clothing classification algorithm based on landmark attention and channel attention [J]. Journal of Jilin University(Engineering and Technology Edition), 2020, 50(5): 1765-1770.
[4] Yan-fen CHENG,Li-juan YAO,Qiao YUAN,Xian-qiao CHEN. Clearing strategy of underwater video image [J]. Journal of Jilin University(Engineering and Technology Edition), 2020, 50(2): 668-677.
[5] Wei ZHANG,Yong HAN,Ming JIN,Xiao-lin QIAO. Toeplitz matrices reconstruction based DOA estimation for coherent signals [J]. Journal of Jilin University(Engineering and Technology Edition), 2020, 50(2): 703-710.
[6] Fu LIU, Mei-jing QUAN, Ke WANG, Yun LIU, Bing KANG, Zhi-wu HAN, Tao HOU. Indoor positioning method based on location fingerprinting of imitating mechanism of scorpion vibration source [J]. Journal of Jilin University(Engineering and Technology Edition), 2019, 49(6): 2076-2082.
[7] Xiao-hui YU,Zhi-cheng ZHANG,Xin-bo LI,Xiao-dong SUN. Parameter estimation of exponentially damped sinusoidsbased on state⁃space model [J]. Journal of Jilin University(Engineering and Technology Edition), 2019, 49(6): 2083-2088.
[8] Zi-ji MA,Hao LU,Yan-ru DONG. Dual path convolutional neural network forsingle image super⁃resolution [J]. Journal of Jilin University(Engineering and Technology Edition), 2019, 49(6): 2089-2097.
[9] Qian XU,Ying LI,Gang WANG. Pedestrian-vehicle detection based on deep learning [J]. Journal of Jilin University(Engineering and Technology Edition), 2019, 49(5): 1661-1667.
[10] Yang LU,Shi-gang WANG,Wen-ting ZHAO,Yan ZHAO. Facial expression recognition based on separability assessment of discrete Shearlet transform [J]. Journal of Jilin University(Engineering and Technology Edition), 2019, 49(5): 1715-1725.
[11] Chao DONG,Jing⁃hong LIU,Fang XU,Ren⁃hao WANG. Fast ship detection in optical remote sensing images [J]. Journal of Jilin University(Engineering and Technology Edition), 2019, 49(4): 1369-1376.
[12] Ke⁃yan WANG,Yan HU,Huai WANG,Yun⁃song LI. Image dehazing algorithm by sky segmentation and superpixel⁃level dark channel [J]. Journal of Jilin University(Engineering and Technology Edition), 2019, 49(4): 1377-1384.
[13] Lu⁃tao LIU,Na LI. Source detection based on coprime array [J]. Journal of Jilin University(Engineering and Technology Edition), 2019, 49(3): 986-993.
[14] Tohtonur,Hai⁃long ZHANG,Jie WANG,Na WANG,Xin⁃chen YE,Wan⁃qiong WANG. High speed median filtering algorithm based on graphics processing unit [J]. Journal of Jilin University(Engineering and Technology Edition), 2019, 49(3): 979-985.
[15] Yin⁃juan FU,Yong LI,Li⁃qin XU,Kun⁃hui ZHANG. Design and analysis of NLFM⁃Costas RF stealth radar signal [J]. Journal of Jilin University(Engineering and Technology Edition), 2019, 49(3): 994-999.
Viewed
Full text


Abstract

Cited
  Shared   
  Discussed   
No Suggested Reading articles found!
Copyright © Journal of Jilin University(Engineering and Technology Edition), All Rights Reserved.
Tel: +86-431-85095297　Fax: +86-431-85094074　E-mail: xbgxb@jlu.edu.cn
Powered by Beijing Magtech Co. Ltd