Journal of Jilin University(Engineering and Technology Edition) ›› 2024, Vol. 54 ›› Issue (8): 2313-2318.doi: 10.13229/j.cnki.jdxbgxb.20230197

Previous Articles     Next Articles

Fusion algorithm of convolution neural network and bilateral filtering for seam extraction

Jin-zhou ZHANG(),Shi-qing JI,Chuang TAN   

  1. College of Mechanical Engineering,Yangtze University,Jingzhou 434023,China
  • Received:2023-03-06 Online:2024-08-01 Published:2024-08-30

Abstract:

The extraction accuracy of intersecting line weld affects the accuracy of industrial welding, which is an important step of weld technology and one of the key issues in industrial research. In order to solve the problems existing in the traditional method, the intersection line weld extraction algorithm based on convolution neural network and bilateral filtering is proposed. Firstly, the weld image of the intersecting line is grayed and enhanced by the contour wave transformation method; Secondly, the weld image is de-noised by bilateral filtering method; Finally, the intersecting line weld seam is extracted through the full convolution neural network. The experimental results show that the proposed method has higher accuracy, faster speed and better overall application effect.

Key words: Image denoising, convolution neural network, Image enhancement processing, Bilateral filtering, extraction of intersecting line weld

CLC Number: 

  • TG409

Fig.1

Contour wave transformation principle"

Fig.2

Structure diagram of full convolution neural network model"

Fig.3

Effect of three algorithms on seam extraction of intersecting line"

Table 1

Comparison of extraction deviation of intersecting line weld"

序号偏差[x/y pixel]
文献[3]算法文献[4]算法所提算法
15651023
2784813
3[6,4]29[2,2]
45738[2,1]
5[8,6]47[3,1]
1 霍建红, 郭晓晖, 王永胜, 等. 基于激光视觉的相贯线焊接装备的研制[J]. 现代制造工程, 2022(3): 92-97.
Huo Jian-hong, Guo Xiao-hui, Wang Yong-sheng, et al. Development of intersecting line welding equipment based on laser vision[J]. Modern Manufacturing Engineering, 2022 (3): 92-97
2 王濠, 李亮峰, 张延松. 基于分段线性拟合的典型焊缝特征提取[J]. 机械设计与研究, 2021, 37(6): 122-127.
Wang Hao, Li Liang-feng, Zhang Yan-song. Feature extraction of typical weld based on piecewise linear fitting[J]. Machine Design & Research, 2021,37 (6): 122-127
3 夏攀, 马飞, 王中任. 基于改进U-Net模型的焊缝特征提取[J].激光与红外, 2022, 52(8): 1259-1264.
Xia Pan, Ma Fei, Wang Zhong-ren.Weld feature extraction based on modified U-Net model[J]. Laser & Infrared, 2022,52 (8): 1259-1264.
4 李湘文, 黄宏亮, 洪波, 等. 基于管道插接的相贯线焊缝提取算法及数值模拟[J]. 焊接学报, 2022, 43(9): 98-103, 119-120.
Li Xiang-wen, Huang Hong-liang, Hong Bo, et al. Algorithm and numerical simulation of intersecting line weld extraction based on pipeline plugging[J]. Transactions of The China Welding Institution, 2022,43(9): 98-103,119-120.
5 汤自强, 郭彦兵, 张旺. 基于激光视觉传感及改进Canny边缘算法的焊缝三维轮廓特征提取研究[J]. 热加工工艺, 2021, 50(21): 113-117, 123.
Tang Zi-qiang, Guo Yan-bing, Zhang Wang. Study on 3D contour feature extraction of welds based on laser vision sensing and improved canny edge algorithm [J]. Hot Working Technology, 2021,50(21): 113-117, 123.
6 郭志军, 刘帅. 基于卷积神经网络的数字图像模糊增强算法[J]. 吉林大学学报: 工学版, 2022, 52(10): 2399-2404.
Guo Zhi-jun, Liu Shuai. Digital image fuzzy enhancement algorithm based on convolutional neural networks[J]. Journal of Jilin University (Engineering Edition), 2022, 52(10): 2399-2004.
7 万园园, 王雨青, 张晓宁, 等. 结合全局语义优化的对抗性灰度图像彩色化[J]. 液晶与显示, 2021, 36(9): 1305-1313.
Wan Yuan-yuan, Wang Yu-qing, Zhang Xiao-ning, et al. Adversarial grayscale image colorization combined with global semantic optimization[J]. Chinese Journal of Liquid Crystals and Displays, 2021,36 (9): 1305-1313.
8 张毅, 韦文闻, 龚致远. 基于深层聚合结构网络的灰度图像彩色化方法[J]. 计算机应用研究, 2021, 38(3): 923-927.
Zhang Yi, Wei Wen-wen, Gong Zhi-yuan. Gray image colorization method based on deep layer aggregation[J]. Application Research of Computers, 2021,38(3): 923-927
9 韩梦妍, 李良荣, 蒋凯. 基于光照图估计的Retinex低照度图像增强算法[J]. 计算机工程, 2021, 47(10): 201-206.
Han Meng-yan, Li Liang-rong, Jiang Kai. Retinex low-illumination image enhancement algorithm based on light image estimation[J]. Computer Engineering, 2021,47(10): 201-206
10 薛双青, 贺东东. 基于2D-VMD和双边滤波的医学超声图像去噪算法[J]. 西安科技大学学报, 2021, 41(3): 516-523.
Xue Shuang-qing, He Dong-dong. Denoising algorithm for medical ultrasound image based on 2D-VMD and bilateral filtering [J]. Journal of Xi´an University of Science and Technology, 2021,41 (3): 516-523.
11 秦毅, 赵二刚. 结合Curvelet变换与加权双边滤波的图像去噪方法[J].西南师范大学学报: 自然科学版, 2021, 46(1): 7-12.
Qin Yi, Zhao Er-gang.On Image denoising method combined with curvelet transform and weighted bilateral filtering [J]. Journal of Southwest China Normal University (Natural Science Edition), 2021,46(1): 7-12.
12 王惠琴, 吕佳芸, 张伟. 基于双边滤波-BM3D算法的GPR图像去噪[J]. 兰州理工大学学报, 2022, 48(1): 91-97.
Wang Hui-qin, Jia-yun Lyu, Zhang Wei. GPR image denoising based on bilateral filtering BM3D algorithm[J]. Journal of Lanzhou University of Technology, 2022,48(1): 91-97.
13 高博钰, 杨波, 张德国. U-Net深度卷积神经网络在沙脊线提取中的应用[J]. 中国沙漠, 2021, 41(5): 21-32.
Gao Bo-yu, Yang Bo, Zhang De-guo.Extracting the sand dune crest lines from satellite images using U-Net deep convolutional neural network[J]. Journal of Desert Research, 2021,41(5): 21-32.
14 王海霞, 单鲁斌, 庞巧玲, 等. 基于卷积神经网络的指纹条纹图相位提取方法[J]. 光子学报, 2022, 51(6): 380-393.
Wang Hai-xia, Shan Lu-bin, Pang Qiao-ling, et al. Phase extraction method of fingerprint fringe pattern based on convolutional neural network[J]. Acta Photonica Sinica, 2022,51(6): 380-393.
15 申铉京, 张雪峰, 王玉, 等. 像素级卷积神经网络多聚焦图像融合算法[J]. 吉林大学学报: 工学版, 2022, 52(8): 1857-1864.
Shen Xuan-jing, Zhang Xue-feng, Wang Yu, et al. Multi-focus image fusion algorithm based on pixel-level convolutional neural network[J]. Journal of Jilin University (Engineering Edition), 2022, 52(8): 1857-1864.
[1] Chao-lu TEMUR,Ya-ping ZHANG. Link anomaly detection algorithm for wireless sensor networks based on convolutional neural networks [J]. Journal of Jilin University(Engineering and Technology Edition), 2024, 54(8): 2295-2300.
[2] Hong-wei ZHAO,Hong WU,Ke MA,Hai LI. Image classification framework based on knowledge distillation [J]. Journal of Jilin University(Engineering and Technology Edition), 2024, 54(8): 2307-2312.
[3] Xin-gang GUO,Ying-chen HE,Chao CHENG. Noise-resistant multistep image super resolution network [J]. Journal of Jilin University(Engineering and Technology Edition), 2024, 54(7): 2063-2071.
[4] Li-bo CHENG,Xin-yue LI,Zhe LI,Xiao-ning JIA. Remote sensing image denoising method based on curvelet transform and goodness-of-fit test [J]. Journal of Jilin University(Engineering and Technology Edition), 2023, 53(11): 3207-3213.
[5] Xiao-hui WANG,Lu-shen WU,Hua-wei CHEN. Denoising of scattered point cloud data based on normal vector distance classification [J]. Journal of Jilin University(Engineering and Technology Edition), 2020, 50(1): 278-288.
[6] You ZHOU,Sen YANG,Da-lin LI,Chun-guo WU,Yan WANG,Kang-ping WANG. Acceleration platform for face detection and recognition based on field⁃programmable gate array [J]. Journal of Jilin University(Engineering and Technology Edition), 2019, 49(6): 2051-2057.
[7] Ji-chang GUO,Jie WU,Chun-le GUO,Ming-hui ZHU. Image super-resolution reconstruction based on residual connection convolutional neural network [J]. Journal of Jilin University(Engineering and Technology Edition), 2019, 49(5): 1726-1734.
[8] JIANG Chao, GENG Ze-xun, LIU Li-yong, PAN Ying-feng. Maximum likelihood image restoration combined with image denoising [J]. 吉林大学学报(工学版), 2015, 45(4): 1360-1366.
[9] ZHANG Tian, SUN Yan-kui, TIAN Xiao-lin. Optical coherence tomography image denoising method by merging dyadic wavelet and anisotropic diffusion filter [J]. 吉林大学学报(工学版), 2013, 43(增刊1): 340-344.
[10] YU Bo, GUO Lei, QIAN Xiao-liang, ZHAO Tian-yun. Algorithm of steering kernel bilateral filtering [J]. , 2012, (06): 1553-1557.
[11] Cui Yan-qiu;Wang Ke;Sun Wei. Image denoising method based on adaptive Gaussian mixture
model in wavelet domain
[J]. 吉林大学学报(工学版), 2006, 36(06): 983-0988.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
[1] LI Shoutao, LI Yuanchun. Autonomous Mobile Robot Control Algorithm Based on Hierarchical Fuzzy Behaviors in Unknown Environments[J]. 吉林大学学报(工学版), 2005, 35(04): 391 -397 .
[2] Liu Qing-min,Wang Long-shan,Chen Xiang-wei,Li Guo-fa. Ball nut detection by machine vision[J]. 吉林大学学报(工学版), 2006, 36(04): 534 -538 .
[3] Li Hong-ying; Shi Wei-guang;Gan Shu-cai. Electromagnetic properties and microwave absorbing property
of Z type hexaferrite Ba3-xLaxCo2Fe24O41
[J]. 吉林大学学报(工学版), 2006, 36(06): 856 -0860 .
[4] Zhang Quan-fa,Li Ming-zhe,Sun Gang,Ge Xin . Comparison between flexible and rigid blank-holding in multi-point forming[J]. 吉林大学学报(工学版), 2007, 37(01): 25 -30 .
[5] . [J]. 吉林大学学报(工学版), 2007, 37(04): 0 .
[6] Li Yue-ying,Liu Yong-bing,Chen Hua . Surface hardening and tribological properties of a cam materials[J]. 吉林大学学报(工学版), 2007, 37(05): 1064 -1068 .
[7] Feng Hao,Xi Jian-feng,Jiao Cheng-wu . Placement of roadside traffic signs based on visibility distance[J]. 吉林大学学报(工学版), 2007, 37(04): 782 -785 .
[8] Zhang He-sheng, Zhang Yi, Wen Hui-min, Hu Dong-cheng . Estimation approaches of average link travel time using GPS data[J]. 吉林大学学报(工学版), 2007, 37(03): 533 -0537 .
[9] Qu Zhao-wei,Chen Hong-yan,Li Zhi-hui,Hu Hong-yu,Wei Wei . 2D view reconstruction method based on single calibration pattern
[J]. 吉林大学学报(工学版), 2007, 37(05): 1159 -1163 .
[10] Nie Jian-jun,Du Fa-rong,Gao Feng . Finite time thermodynamics of real combined power cycle operating
between internal combustion engine and Stirling engine with heat leak
[J]. 吉林大学学报(工学版), 2007, 37(03): 518 -0523 .