Journal of Jilin University(Engineering and Technology Edition) ›› 2024, Vol. 54 ›› Issue (3): 741-748.doi: 10.13229/j.cnki.jdxbgxb.20220473

Previous Articles    

Vehicle distance warning method based on improved YOLOv4⁃tiny algorithm

Hong-zhi WANG(),Ming-xuan SONG,Chao CHENG,Dong-xuan XIE()   

  1. College of Computer Science and Engineering,Changchun University of Technology,Changchun 130012,China
  • Received:2022-04-24 Online:2024-03-01 Published:2024-04-18
  • Contact: Dong-xuan XIE E-mail:wanghongzi@ccut.edu.cn;xiedongxuan@ccut.edu.cn

Abstract:

Aiming at the problem that the existing network is difficult to accurately recognize the target of road detection and vehicle distance in real time, a vehicle distance warning method based on improved YOLOv4-tiny algorithm was proposed. Firstly, the feature extraction structure of YOLOv4-tiny algorithm was summarized, and the shortcomings of the original network structure were analyzed. Secondly, SPPF of spatial pyramid pooling layer was added to the original network to further extract target features and enhance the ability to express deep semantic information. Feature Pyramid Network (FPN) structure was added with down-sampling channel and CSPnet layer to fully integrate multi-scale image features and avoid the loss of shallow information. Finally, the Mosaic data enhancement method was used to enrich the data set training samples, and the improved YOLOv4-tiny algorithm was combined with the principle of single visual distance detection. The vehicle distance warning experiment was conducted by setting three levels of information cues according to the vehicle distance. The results show that the detection speed of the proposed algorithm on PASCAL VOC dataset is 43 frames/s, and the average accuracy is 81.25%, which is 3.59% higher than that of YOLOv4-tiny algorithm. It can be seen that the improved YOLOv4-tiny algorithm has good target detection accuracy while meeting the real-time requirements of detection, which has guiding significance for improving the application effect of vehicle distance warning method.

Key words: engineering of communications and transportation safety, target detection, YOLOv4-tiny algorithm, monocular distance measurement, vehicles warning

CLC Number: 

  • U492.8

Fig.1

Structure of YOLOv4-tiny network"

Fig.2

Diagram of FPN feature fusion structure"

Fig.3

YOLOv4-Tiny improved network structure"

Fig.4

Principle diagram of spatial pyramid pooling"

Fig.5

Schematic diagram of the SPPF structure"

Fig.6

Schematic diagram of two-way FPN structure"

Fig.7

Residual structure diagram of CSPnet"

Fig.8

Using Mosaic data to enhance graphics"

Fig.9

Training loss curve"

Table 1

Performance of the proposed algorithm is compared with that of recent target detection algorithms"

算法AP/%mAP/%FPS
BusCarMotorbikeBicyclePerson
YOLOv4-tiny2186.1190.8885.3586.1986.0077.6675.51
Faster RCNN-vgg965.8979.7168.6575.7477.6962.7622.48
Faster RCNN-Resnet967.8681.1473.1072.3679.4065.9915.21
Ssd-Mobilenetv21681.6085.8284.8483.5175.8975.2939.14
Mobilenetv1-YOLOv42786.1289.0584.6687.5884.6680.5036.03
Mobilenetv2-YOLOv42884.9190.4385.6988.8884.7281.3229.95
Mobilenetv3-YOLOv42986.0988.5083.4487.0784.5379.7426.31
本文90.2191.9087.8387.4086.8881.2543.37

Fig.10

MAP curve comparison between YOLOv4-tiny and the algorithm in this paper"

Table 2

MV-CE120-10UC industrial camera parameters"

参数数值参数数值
像元尺寸/ μm×μm1.85×1.85信噪比/dB40.5
靶面尺寸1/1.7"增益/dB0~27
分辨率/dpi4000×3036曝光时间/s0.000 03~0.5
动态范围/dB70~71适配镜头焦距/mm6

Fig.11

Result of target ranging on road during the day"

Fig.12

Result of target ranging on road at night"

1 王新竹, 李骏, 李红建, 等. 基于三维激光雷达和深度图像的自动驾驶汽车障碍物检测方法[J]. 吉林大学学报: 工学版, 2016, 46(2): 360-365.
Wang Xin-zhu, Li Jun, Li Hong-jian, et al. Obstacle detection method for autonomous vehicles based on 3D lidar and depth image[J]. Journal of Jilin University (Engineering Science), 2016, 46(2): 360-365.
2 周俊静, 段建民, 杨光祖. 基于雷达测距的车辆识别与跟踪方法[J]. 汽车工程, 2014, 36(11): 1415-1420.
Zhou Jun-jing, Duan Jian-min, Yang Guang-zu. Vehicle recognition and tracking method based on radar ranging[J]. Automotive Engineering, 2014, 36(11): 1415-1420.
3 邹斌, 袁宇翔. 面向智能交通的单目视觉测距方法研究[J]. 交通运输系统工程与信息, 2018, 18(4): 46-53.
Zou Bin, Yuan Yu-xiang. Research on monocular visual ranging method for intelligent transportation[J]. Transportation Systems Engineering and Information, 2018, 18(4): 46-53.
4 李琳辉, 伦智梅, 连静, 等. 基于卷积神经网络的道路车辆检测方法[J]. 吉林大学学报: 工学版, 2017, 47(2): 384-391.
Li Lin-hui, Zhi-mei Lun, Lian Jing, et al. Road vehicle detection method based on convolutional neural network[J]. Journal of Jilin University (Engineering Edition), 2017, 47(2): 384-391.
5 文学志, 方巍, 郑钰辉. 一种基于类Haar特征和改进AdaBoost分类器的车辆识别算法[J]. 电子学报, 2011, 39(5): 1121-1126.
Wen Xue-zhi, Fang Wei, Zheng Yu-hui. A vehicle recognition algorithm based on Haar-like features andimproved AdaBoost classifier[J]. Journal of Electronis, 2011, 39(5): 1121-1126.
6 Lienhart R, Maydt J. An extended set of Haar-like features for rapid object detection[J/OL]. [2022-03-15].
7 Dooley D, Mcginley B, Hughes C, et al. A blind-zone detection method using a rear-mounted fisheye camera with combination of vehicle detection methods[J]. IEEE Transactions on Intelligent Transportation Systems, 2015, 17(1): 264-278.
8 Girshick R, Donahue J, Darrell T, et al. Rich feature hierarchies for accurate object detection and semantic segmentation[C]∥Proceedings of 2014 IEEE International Conference on Computer Vision and Pattern Recognition, Columbus, USA, 2014: 580-587.
9 Girshick R. Fast R-CNN[C]∥Proceedings of 2015 IEEE International Conference on Computer Vision, San-tiago, Chile, 2015: 1440-1448.
10 He K, Xiang Y, Shao Q, et al. Spatial pyramid pooling in deep convolutional networks for visual recognition[J]. IEEE Transactions on Pattern Analysis & Machine Intelligence, 2014, 37(9): 1904-1916.
11 Ren S, He K, Girshick R, et al. Faster R-CNN: towards real-time object detection with region proposal networks[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2017, 39(6): 1137-1149.
12 彭博, 蔡晓禹, 唐聚, 等. 基于改进Faster R-CNN的无人机视频车辆自动检测[J]. 东南大学学报: 自然科学版, 2019, 49(6): 1199-1204.
Peng Bo, Cai Xiao-yu, Tang Ju, et al. Automatic detection of UAV video vehicles based on improved Faster R-CNN[J]. Journal of Southeast University (Natural Science Edition), 2019, 49(6): 1199-1204.
13 Redmon J, Divvala S, Girshick R, et al. You only look once: unified, real-time object detection[C]∥2016 IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, USA, 2016: 779-788.
14 Redmon J, Farhadi A. YOLO9000: better, faster, stronger[C]∥IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, USA, 2017: 6517-6525.
15 Redmon J, Farhadi A. YOLOv3: an incremental improvement[J/OL]. [2022-03-17].
16 Bochkovskiy A, Wang C Y, Liao H. YOLOv4: optimal speed and accuracy of object detection[J/OL]. [2022-03-17].
17 Liu W, Anguelov D, Erhan D, et al. SSD: single shot multibox detector[C]∥European Conference on Computer Vision. Berlin: Springer, 2016: 21-37.
18 谭红臣, 李淑华, 刘彬, 等. 特征增强的SSD算法及其在目标检测中的应用[J]. 计算机辅助设计与图形学学报, 2019, 31(4): 573-579.
Tan Hong-chen, Li Shu-hua, Liu Bin, et al. Feature enhanced SSD algorithm and its application in object detection[J]. Journal of Computer Aided Design and Graphics, 2019, 31(4): 573-579.
19 Huang J, Rathod V, Sun C, et al. Speed/accuracy trade-offs for modern convolutional object detectors[C]∥Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, USA, 2017: 7310-7311.
20 Concise feature pyramid region proposal network formulti-scale object detection[J]. Journal of Supercomp-uting, 2020, 76(5): 3327-3337.
21 Lin T Y, Dollar P, Girshick R, et al. Feature pyramid networks for object detection[C]∥2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, USA, 2017: 936-944.
22 Wang C Y, Liao H, Wu Y H, et al. CSPNet: a new backbone that can enhance learning capability of CNN[C]∥Proceedings of IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPR), Seattle, USA, 2020: 1571-1580.
23 Li Z, Wang H, Zhong H, et al. Self-attention moduleand FPN-based remote sensing image target detection[J]. Arabian Journal of Geosciences, 2021, 14(23): 1-18.
24 Prasetyo E, Suciati N, Fatichah C. Yolov4-tiny and spatial pyramid pooling for detecting head and tail of fish[C]∥2021 International Conference on Artificial Intelligence and Computer Science Technology (ICAICST), Yogyakarta, Indonesia, 2021: 157-161.
25 Shum H Y, Szeliski R, Systems and experiment paper : construction of panoramic image mosaics with global and local alignment[J]. International Journal of Computer Vision, 2000, 36(2): 101-130.
26 Zheng Z, Wang P, Liu W, et al. Distance-IoU loss: faster and better learning for bounding box regression[J]. AAAI Technical Track: Vision, 2019, 34(7): 12993-13000.
27 Li G, Liu Z, Li F, et al. Block Convolution: towards memory-efficient inference of large-scale CNNs on FPGA[J]. IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, 2021, 41(5): 1436-1447.
28 Zhang L, Wang S, Sun H, et al. Research on dual mode target detection algorithm for embedded platform[J]. Complexity, 2021, 2021(8): 1-8.
29 Liu C, Su X Y, Wu J, et al. Method for detecting surface defects of runner blades of large hydraulic turbines based on improved real-time lightweight net-work[J]. Journal of Physics Conference Series, 2021, 1955(1): 714-724.
30 Shen C, Zhao X, Liu Z, et al. Joint vehicle detection and distance prediction via monocular depth estimation[J]. IET Intelligent Transport Systems, 2020, 14(7): 753-763.
31 Zhe T, Huang L, Wu Q, et al. Inter-vehicle distance estimation method based on monocular vision using 3D detection[J]. IEEE Transactions on Vehicular Technology, 2020, 69(5): 4907-4919.
[1] Heng-yan PAN,Wen-hui ZHANG,Ting-ting LIANG,Zhi-peng PENG,Wei GAO,Yong-gang WANG. Inducement analysis of taxi drivers' traffic accidents based on MIMIC and machine learning [J]. Journal of Jilin University(Engineering and Technology Edition), 2023, 53(2): 457-467.
[2] Ming-hua GAO,Can YANG. Traffic target detection method based on improved convolution neural network [J]. Journal of Jilin University(Engineering and Technology Edition), 2022, 52(6): 1353-1361.
[3] De-lun PAN,Jun JI,Yue-jin ZHANG. Dynamic object detection method of video surveillance based on motion vector space coding [J]. Journal of Jilin University(Engineering and Technology Edition), 2021, 51(4): 1370-1374.
[4] Xue-yun CHEN,Tao XU,Xiao-qiao HUANG. Detection method of medical cell image generation based on conditional generative adversarial network [J]. Journal of Jilin University(Engineering and Technology Edition), 2021, 51(4): 1414-1419.
[5] Lu WANG,Yu⁃wen LIU,Hong CHEN. Cross-wind environment vehicle driving feature at canyon bridge and tunnel connection segment [J]. Journal of Jilin University(Engineering and Technology Edition), 2019, 49(3): 736-748.
[6] TAN Li-dong, LIU Dan, LI Wen-jun. Design of bionic compound eye array for traffic accident scene panorama based on fly compound eye [J]. 吉林大学学报(工学版), 2017, 47(6): 1738-1744.
[7] LI Xian-sheng, MENG Xiang-yu, ZHENG Xue-lian, CHENG Zhu-qing, REN Yuan-yuan. Dynamic characteristics of liquid sloshing in partially-filled tank [J]. 吉林大学学报(工学版), 2017, 47(3): 737-743.
[8] JIANG Hong, LI Yin, LYU Wei. Linear shrinkage-based blind target detection for MIMO radar with large arrys [J]. 吉林大学学报(工学版), 2017, 47(3): 973-980.
[9] XU Jin, CHEN Wei, ZHOU Jia, LUO Xiao, SHAO Yi-ming. Correlation between steering and driver's workload [J]. 吉林大学学报(工学版), 2017, 47(2): 438-445.
[10] GUO Ying-shi, FU Rui, ZHAO Kai, MA Yong, YUAN Wei. Evaluation and test of real-time identification models of driver's lane change intention [J]. 吉林大学学报(工学版), 2016, 46(6): 1836-1844.
[11] WANG Zhe, YANG Bai-ting, LIU Xin, LIU Qun, SONG Xian-min. Discriminant analysis of driving decisions based on fuzzy clustering [J]. 吉林大学学报(工学版), 2015, 45(5): 1414-1419.
[12] ZHENG Xue-lian, LI Xian-sheng, REN Yuan-yuan, WANG Yu-ning, YANG Meng. Equivalent mechanical model for liquid sloshing in partially-filled tank vehicle [J]. 吉林大学学报(工学版), 2013, 43(06): 1488-1493.
[13] GUO Lie, HUANG Xiao-hui, GE Ping-shu, ZHANG Guang-xi, YUE Ming. Lane changing trajectory tracking control for intelligent vehicle on curved road based on backstepping [J]. 吉林大学学报(工学版), 2013, 43(02): 323-328.
[14] XU Cheng-cheng, LIU Pan, WANG Wei, LI Zhi-bin. Real time crash risk prediction model on freeways under nasty weather conditions [J]. 吉林大学学报(工学版), 2013, 43(01): 68-73.
[15] WANG Lin-hong, LI Shi-wu, ZHOU Ru-bo, YANG Zhi-fa, JI Bing-kui, YAO Xue-ping. Impact of roadside landscape color on driver mean heart rate [J]. 吉林大学学报(工学版), 2013, 43(01): 74-80.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!