基于深度学习的车载图像车辆目标检测和测距

doi:10.13229/j.cnki.jdxbgxb.20230321

Abstract

Abstract:

In order to improve the vehicle target detection accuracy and ranging stability in the driving environment， a deep learning-based vehicle target detection and ranging method is proposed. The YOLOX-S algorithm is used as the vehicle target detection framework for improvement： on the basis of the original algorithm， the CBAM attention module is introduced to enhance the network feature expression ability， and the confidence loss function is replaced with Focal Loss， which reduces the training weight of simple samples and improves the positive sample attention. The vehicle ranging model is established according to the imaging principle and geometric relationship of the vehicle camera， and the ranging results are obtained by inputting the coordinates of the ranging feature points and the internal reference of the camera. The improved YOLOX-S algorithm is trained and evaluated using the home-made Tlab dataset and BDD 100K dataset， and the static ranging experimental scenario is constructed to validate the vehicle ranging model. The experimental results show that the improved YOLOX-S algorithm has a detection speed of 70.14 frames/s on the experimental dataset， and the precision， recall， F₁ value， and mAP are improved by 0.86%， 1.32%， 1.09%， and 1.54% respectively compared with the original algorithm； the average ranging error stays within 3.20% in the longitudinal 50m and lateral 11.25 m measurement range. It can be seen that the method in this paper has good vehicle ranging accuracy and stability while meeting the real-time requirements of vehicle detection.

Key words: transportation planning and management, deep learning, environment awareness, in-vehicle imagery, target detection, monocular ranging

CLC Number:

U495

Hui-zhi XU,Shi-sen JIANG,Xiu-qing WANG,Shuang CHEN. Vehicle target detection and ranging in vehicle image based on deep learning[J].Journal of Jilin University(Engineering and Technology Edition), 2025, 55(1): 185-197.

Figures/Tables 18

Fig.1

Fig.2

Fig.3

Fig.4

Fig.5

Fig.6

Fig.7

Fig.8

Fig.9

Fig.10

Fig.11

Table 1

Table 2

Fig.12

Table 3

Fig.13

Table 4

Table 5

Results of comparative experiment on vehicle ranging"

纵向距离/m	横向距离/m	实际距离/m	预测距离/m			预测误差/%
			纵向距离/m	横向距离/m	实际距离/m	纵向误差/%	横向误差/%	实际误差/%
			Ⅰ Ⅱ	Ⅰ Ⅱ	Ⅰ Ⅱ	Ⅰ Ⅱ	Ⅰ Ⅱ	Ⅰ Ⅱ
5	-	5	5.22 5.26	-	5.22 5.26	4.40 5.20	-	4.40 5.20
10	-	10	10.39 10.45	-	10.39 10.45	3.90 4.50	-	3.90 4.50
10	3.75	10.68	10.45 10.56	3.65 3.72	11.07 11.20	4.50 5.60	2.67 0.80	3.64 4.83
15	-	15	15.57 15.63	-	15.57 15.63	3.80 4.20	-	3.80 4.20
	3.75	15.46	15.24 14.74	3.64 3.51	15.67 15.15	1.60 1.73	2.93 6.40	1.35 1.99
	7.5	16.77	14.32 14.09	7.37 7.22	16.11 15.83	4.53 6.07	1.73 3.73	3.94 5.59
20	-	20	19.43 20.47	-	19.43 20.47	2.85 2.35	-	2.85 2.35
	3.75	20.35	19.79 19.68	3.87 3.89	20.16 20.06	1.05 1.60	3.20 3.73	0.91 1.43
	7.5	21.36	20.26 20.41	7.18 7.19	21.49 21.64	1.30 2.05	4.27 4.13	0.63 1.31
	11.25	22.95	19.61 19.13	10.75 10.52	22.36 21.83	1.95 4.35	4.44 6.49	2.56 4.88
25	-	25	24.31 24.02	-	24.31 24.02	2.76 3.92	-	2.76 3.92
	3.75	25.28	26.11 26.43	3.57 3.61	26.35 26.68	4.44 5.72	4.80 3.73	4.24 5.54
	7.5	26.1	24.04 24.13	7.13 7.02	25.08 25.13	3.84 3.48	4.93 6.40	3.93 3.71
	11.25	27.41	23.78 26.35	11.82 11.95	26.56 28.93	4.88 5.40	5.07 6.22	3.12 5.56
30	-	30	29.14 28.59	-	29.14 28.59	2.87 4.70	-	2.87 4.70
	3.75	30.23	28.82 31.35	3.91 3.87	29.08 31.59	3.93 4.50	4.27 3.20	3.79 4.49
	7.5	30.92	28.58 29.05	7.60 7.91	29.57 30.11	4.73 3.17	1.33 5.47	4.36 2.63
	11.25	32.04	30.91 31.11	10.66 10.95	32.70 32.98	3.03 3.70	5.24 2.67	2.05 2.94
35	-	35	33.57 33.24	-	33.57 33.24	4.09 5.03	-	4.09 5.03
	3.75	35.2	34.29 34.43	3.94 3.60	34.52 34.62	2.03 1.63	5.07 4.00	1.94 1.65
	7.5	35.79	36.13 36.63	7.89 7.93	36.98 37.48	3.23 4.66	5.20 5.73	3.33 4.72
	11.25	36.76	35.95 36.29	11.56 11.44	37.76 38.05	2.71 3.69	2.76 1.69	2.73 3.51
40	-	40	38.52 38.76	-	38.52 38.76	3.70 3.10	-	3.70 3.10
	3.75	40.18	41.69 41.94	3.57 3.46	41.74 42.08	4.22 4.85	4.80 7.73	3.88 4.73
	7.5	40.7	38.25 38.05	7.75 7.92	39.03 38.87	4.38 4.88	3.33 5.60	4.11 4.51
	11.25	41.55	39.26 40.92	11.78 11.85	40.99 42.60	1.85 2.30	4.71 5.33	1.35 2.53
45	-	45	44.66 46.61	-	44.66 46.61	0.76 3.58	-	0.76 3.58
	3.75	45.16	46.17 46.94	3.81 3.82	46.33 47.10	2.60 4.31	1.60 1.87	2.58 4.29
	7.5	45.62	43.39 43.05	7.88 7.97	44.10 43.78	3.58 4.33	5.07 6.27	3.33 4.03
	11.25	46.38	46.50 43.24	11.57 11.60	47.92 44.77	3.33 3.91	2.84 3.11	3.32 3.47
50	-	50	47.87 47.28	-	47.87 47.28	4.26 5.44	-	4.26 5.44
	3.75	50.14	48.35 48.54	3.91 3.98	48.51 48.70	3.30 2.92	4.27 6.13	3.26 2.87
	7.5	50.56	49.85 52.56	7.62 7.70	50.43 53.12	0.30 5.12	1.60 2.67	0.26 5.07
	11.25	51.25	51.18 52.90	11.28 11.19	52.41 54.07	2.36 5.80	0.27 0.53	2.26 5.50

Table 5

References 23

1	刘旖菲, 胡学敏, 陈国文, 等. 视觉感知的端到端自动驾驶运动规划综述[J]. 中国图象图形学报, 2021, 26(1): 49-66.
	Liu Yi-fei, Hu Xue-min, Chen Guo-wen, et al. A review of end-to-end autonomous driving motion planning with visual perception[J]. Chinese Journal of Graphical Graphics, 2021, 26(1): 49-66.
2	原晓佩, 陈小锋, 廉明. 基于Haar-like和LBP的多特征融合目标检测算法[J]. 计算机科学, 2021, 48(11): 219-225.
	Yuan Xiao-pei, Chen Xiao-feng, Lian Ming. A multi-feature fusion target detection algorithm based on Haar-like and LBP[J]. Computer Science, 2021, 48(11): 219-225.
3	Lienhart R, Maydt J. An extended set of Haar-like features for rapid object detection[C]∥The IEEE International Conference on Image Processing, New York, USA, 2002: 900-903.
4	辛元雪, 史朋飞, 薛瑞阳. 基于区域提取与改进LBP特征的运动目标检测[J]. 计算机科学, 2021, 48(7): 233-237.
	Xin Yuan-xue, Shi Peng-fei, Xue Rui-yang. Motion target detection based on region extraction with improved LBP features[J]. Computer Science, 2021, 48(7): 233-237.
5	Duan J, Ye H, Zhao H, et al. Deep cascade AdaBoost with unsupervised clustering in autonomous vehicles[J]. Electronics, 2022, 12(1):No.12010044.
6	Yang J, Jun Z. Improved HOG feature vehicle recognition algorithm based on sliding window[J]. Journal of Physics: Conference Series, 2020, 1627(1):No. 012013.
7	耿庆田, 于繁华, 王宇婷, 等. 基于特征融合的车型检测新算法[J]. 吉林大学学报:工学版, 2018, 48(3): 929-935.
	Geng Qing-tian, Yu Fan-hua, Wang Yu-ting, et al. A new algorithm for model detection based on feature fusion[J]. Journal of Jilin University(Engineering Edition), 2018, 48(3): 929-935.
8	高明华, 杨璨. 基于改进卷积神经网络的交通目标检测方法[J]. 吉林大学学报:工学版, 2022, 52(6): 1353-1361.
	Gao Ming-hua, Yang Can. An improved convolutional neural network based traffic target detection method[J]. Journal of Jilin University(Engineering Edition), 2022, 52(6): 1353-1361.
9	Redmon J, Farhadi A. YOLOv3: an incremental improvement[DB/OL].[2023-03-22]..
10	Yue Z, Wei Z, Nan L. A novel detection method using YOLOv5 for vehicle target under complex situation[J]. Traitement du Signal, 2022, 39(4): 1153-1158.
11	Guan X, Meng Y, Meng W, et al. Research on highway vehicle detection based on faster R-CNN and domain adaptation[J]. Applied Intelligence, 2022, 52(4): 3483-3498.
12	Ren S, He K, Girshick R, et al. Faster r-cnn: towards realtime object detection with region proposal networks[J]. Advances in Neural Information Processing Systems, 2015, 28: 91-99.
13	Mescheder L, Oechsle M, Niemeyer M, et al. Occupancy networks: learning 3D reconstruction in function space[C]∥Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, USA, 2019: 4460-4470.
14	黄孝慈, 舒方林, 曹文冠. 基于双目视觉的前方车辆测距方法研究[J]. 汽车技术, 2021(12): 16-21.
	Huang Xiao-ci, Shu Fang-lin, Cao Wen-guan. Research on forward vehicle ranging method based on binocular vision[J]. Automotive Technology, 2021(12): 16-21.
15	Hou A L, Chen J, Jin Z J, et al. Binocular vision measurement of distance based on vehicle logo location[J]. Applied Mechanics and Materials, 2012, 229(1): 1154-1157.
16	Ho H W, Croon G D, Chu Q P. Distance and velocity estimation using optical flow from a monocular camera[J]. International Journal of Micro Air Vehicles, 2017, 9(3): 198-208.
17	高维岳, 陈宇拓, 刘洋, 等. 基于单目视觉的车辆前方障碍物测距方法[J]. 计算机工程与设计, 2022, 43(4): 1016-1022.
	Gao Wei-yue, Chen Yu-tuo, Liu Yang, et al. A monocular vision-based approach to vehicle forward obstacle ranging[J]. Computer Engineering and Design, 2022, 43(4): 1016-1022.
18	Ge Z, Liu S, Wang F, et al. YOLOX: exceeding YOLO Series in 2021[DB/OL].[2023-01-10]. .
19	He K M, Zhang X Y, Ren S Q, et al. Spatial pyramid pooling in deep convolutional networks for visual recognition[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2015, 37(9): 1904-1916.
20	Woo S, Park J, Lee J Y, et al. CBAM: convolutional block attention module[C]∥Proceedings of the European Conference on Computer Vision. Munich: Springer, 2018: 3-19.
21	Lin T, Goyal P, Girshick R, et al. Focal loss for dense object detection[C]∥IEEE International Conference on Computer Vision, Venice, Italy, 2017: 2980-2988.
22	刘佳涛, 张亚萍, 杨雨薇. 基于迁移学习的高效单目图像深度估计[J]. 激光与光电子学进展, 2022, 59(16): 236-244.
	Liu Jia-tao, Zhang Ya-ping, Yang Yu-wei. Efficient monocular image depth estimation based on migration learning[J]. Advances in Lasers and Optoelectronics, 2022, 59(16): 236-244.
23	彭妍, 郭君斌, 于传强, 等. 基于平面变换的高精度相机标定方法[J]. 北京航空航天大学学报, 2022, 48(7): 1297-1303.
	Peng Yan, Guo Jun-bin, Yu Chuan-qiang, et al. A high-precision camera calibration method based on planar transformation[J]. Journal of Beijing University of Aeronautics and Astronautics, 2022, 48(7): 1297-1303.

Related Articles 15

[1]	Lei ZHANG,Jing JIAO,Bo-xin LI,Yan-jie ZHOU. Large capacity semi structured data extraction algorithm combining machine learning and deep learning [J]. Journal of Jilin University(Engineering and Technology Edition), 2024, 54(9): 2631-2637.
[2]	Lu Li,Jun-qi Song,Ming Zhu,He-qun Tan,Yu-fan Zhou,Chao-qi Sun,Cheng-yu Zhou. Object extraction of yellow catfish based on RGHS image enhancement and improved YOLOv5 network [J]. Journal of Jilin University(Engineering and Technology Edition), 2024, 54(9): 2638-2645.
[3]	Chang-jiang ZHENG,Tong-tong TAO,Zhi-chao CHEN. Cascading failure model based on adjustable redistribution of traffic flow [J]. Journal of Jilin University(Engineering and Technology Edition), 2024, 54(9): 2441-2450.
[4]	Xiao-yue WEN,Guo-min QIAN,Hua-hua KONG,Yue-jie MIU,Dian-hai WANG. TrafficPro： a framework to predict link speeds on signalized urban traffic network [J]. Journal of Jilin University(Engineering and Technology Edition), 2024, 54(8): 2214-2222.
[5]	Da-yi QU,Hao-min LIU,Zi-yi YANG,Shou-chen DAI. Dynamic allocation mechanism and model of traffic flow in bottleneck section based on vehicle infrastructure cooperation [J]. Journal of Jilin University(Engineering and Technology Edition), 2024, 54(8): 2187-2196.
[6]	Yun-juan YAN,Wei-xiong ZHA,Jun-gang SHI,Li-ping YAN. Double layer optimization model of charging pile based on random charging demand [J]. Journal of Jilin University(Engineering and Technology Edition), 2024, 54(8): 2238-2244.
[7]	Bai-you QIAO,Tong WU,Lu YANG,You-wen JIANG. A text sentiment analysis method based on BiGRU and capsule network [J]. Journal of Jilin University(Engineering and Technology Edition), 2024, 54(7): 2026-2037.
[8]	Xin-gang GUO,Ying-chen HE,Chao CHENG. Noise-resistant multistep image super resolution network [J]. Journal of Jilin University(Engineering and Technology Edition), 2024, 54(7): 2063-2071.
[9]	Li-ping ZHANG,Bin-yu LIU,Song LI,Zhong-xiao HAO. Trajectory k nearest neighbor query method based on sparse multi-head attention [J]. Journal of Jilin University(Engineering and Technology Edition), 2024, 54(6): 1756-1766.
[10]	Ming-hui SUN,Hao XUE,Yu-bo JIN,Wei-dong QU,Gui-he QIN. Video saliency prediction with collective spatio-temporal attention [J]. Journal of Jilin University(Engineering and Technology Edition), 2024, 54(6): 1767-1776.
[11]	Yu-kai LU,Shuai-ke YUAN,Shu-sheng XIONG,Shao-peng ZHU,Ning ZHANG. High precision detection system for automotive paint defects [J]. Journal of Jilin University(Engineering and Technology Edition), 2024, 54(5): 1205-1213.
[12]	Gui-zhen CHEN,Hui-ting CHENG,Cai-hua ZHU,Yu-ran LI,Yan LI. A risk evaluation method for urban intersections considering drivers' physiological information [J]. Journal of Jilin University(Engineering and Technology Edition), 2024, 54(5): 1277-1284.
[13]	Ren-xiang CHEN,Chao-chao HU,Xiao-lin HU,Li-xia YANG,Jun ZHANG,Jia-le HE. Driver distracted driving detection based on improved YOLOv5 [J]. Journal of Jilin University(Engineering and Technology Edition), 2024, 54(4): 959-968.
[14]	Xiao-hua ZHAO,Chang LIU,Hang QI,Ju-shang OU,Ying YAO,Miao GUO,Hai-yi YANG. Influencing factors and heterogeneity analysis of highway traffic accidents [J]. Journal of Jilin University(Engineering and Technology Edition), 2024, 54(4): 987-995.
[15]	Xiu-jian YANG,Xiao-han JIA,Sheng-bin ZHANG. Characteristics of mixed traffic flow taking account effect of dynamics of vehicular platoon [J]. Journal of Jilin University(Engineering and Technology Edition), 2024, 54(4): 947-958.

Metrics

Viewed

Full text

Abstract

Cited

Shared

Discussed

Comments

Recommended 0

No Suggested Reading articles found!

模型	Precision/%	Recall/%	F₁/%	mAP/%	FPS/（帧·s^-1）
YOLOX-S	86.77	90.79	88.75	93.17	75.49
YOLOX-S+CBAM	87.45（+0.68）	91.13（+0.34）	89.26（+0.51）	93.62（+0.45）	70.36（-5.13）
YOLOX-S+Focal Loss	87.08（+0.31）	91.27（+0.48）	89.11（+0.36）	93.89（+0.72）	75.32（-0.17）
YOLOX-S+CBAM+Focal Loss	87.63（+0.86）	92.11（+1.32）	89.84（+1.09）	94.71（+1.54）	70.14（-5.35）

模型	Precision/%	Recall/%	F₁/%	mAP/%	FPS/（帧·s^-1）	模型大小/MB
Fater R-CNN	61.13	95.30	74.49	92.16	26.54	108.29
SSD	84.45	84.72	84.62	89.01	58.87	92.13
YOLOv4	85.68	63.87	73.15	76.54	40.58	244.45
YOLOv5s	83.59	77.36	80.37	77.14	76.22	27.17
YOLOX-S	86.77	90.79	88.75	93.17	75.49	34.39
改进的YOLOX-S	87.63	92.11	89.84	94.71	69.14	36.08

实验场景	检测算法	u_min	v_min	u_max	v_max	u	v	预测纵向距离/m	预测横向距离/m	预测实际距离/m
图13（a）	Ⅰ	1 276	470	1 641	698	1 458.50	698	10.45	3.65	11.07
图13（a）	Ⅱ	1 280	472	1 644	696.50	1 462	696.50	10.56	3.72	11.19
图13（b）	Ⅰ	1 184	473	1 421	634.50	1 302.50	634.50	15.24	3.64	15.67
图13（b）	Ⅱ	1 180	471	1 422	638	1301	639	14.74	3.51	15.15
图13（c）	Ⅰ	1 532	475	1 855	643.50	1 693.50	643.50	14.32	7.37	16.11
图13（c）	Ⅱ	1 529	475	1 851	646	1 690	646	14.09	7.22	15.83
图13（d）	Ⅰ	1 154	481	1 328	602.50	1241	602.50	19.79	3.87	20.16
图13（d）	Ⅱ	1 156	478	1 333	602	1 244.50	603	19.68	3.89	20.06
图13（e）	Ⅰ	1 363	479	1 570	600	1 466.50	600	20.26	7.18	21.49
图13（e）	Ⅱ	1 359	482	1 569	602.50	1 464	599	20.41	7.19	21.64
图13（f）	Ⅰ	1 640	480	1 842	603.50	1 741	603.50	19.61	10.75	22.36
图13（f）	Ⅱ	1 640	483	1 844	606	1 742	606	19.13	10.52	21.83

Vehicle target detection and ranging in vehicle image based on deep learning

RICH HTML

PDF (PC)