Journal of Jilin University(Engineering and Technology Edition) ›› 2025, Vol. 55 ›› Issue (3): 938-946.doi: 10.13229/j.cnki.jdxbgxb.20230553

Previous Articles     Next Articles

Improved Faster⁃RCNN algorithm for traffic sign detection

Xue-jun LI1(),Lin-fei QUAN1,Dong-mei LIU1(),Shu-you YU2   

  1. 1.College of Electronic & Information Engineering,Changchun University,Changchun 130012,China
    2.Department of Control Science & Engineering,Jilin University,Changchun 130012,China
  • Received:2023-06-01 Online:2025-03-01 Published:2025-05-20
  • Contact: Dong-mei LIU E-mail:lixj@ccu.edu.cn;liudm@ccu.edu.cn

Abstract:

An improved Faster-RCNN algorithm for detecting small traffic signs was proposed, which addresses the issues of poor recognition performance of distant small targets and high computation cost in real-world traffic scenes affected by weather and lighting conditions. Based on the basic architecture of Faster-RCNN, the algorithm reconstructs the backbone network and improves the region proposal network to make the network framework lightweight. A multi-scale feature fusion network is designed by integrating the scSE attention and GSConv modules, and the Anchors box size was updated to improve the localization and recognition of traffic sign targets. The ROI Align pooling operation with bilinear interpolation for each target subregion was used to preserve the detailed features of the target region and improve the ability to capture details of distant targets. The balanced L1 loss function was adopted to address the problem of imbalance between samples with large gradient difficulty and those with small gradient easiness, thus improving the training effect. Experiments were conducted on the expanded TT100K dataset. Results show that compared with traditional Faster-RCNN, the model weight is reduced by 200 MB, and detection accuracy is improved by 21.3%. The algorithm achieves a detection accuracy of 85% in low-intensity environments such as cloudy days, which helps improve the traffic sign detection performance in extreme environments.

Key words: environmental awareness, traffic sign detection, TT100K, Faster-RCNN, multi-scale feature fusion

CLC Number: 

  • TP391

Fig.1

Comparison chart of the model framework before and after improvement"

Fig.2

Inverted residual structure"

Fig.3

GA-FPN network structure"

Fig.4

Specific parameters of the type of anchor frame"

Fig.5

Comparison chart of the work mechanism before and after improvement"

Fig.6

45 classes of flags selected in the TT100K dataset"

Table 1

Experiment uses a dataset"

类别名称训练数量测试数量
禁止5 6841 768
警告5 1321 312
指示4 8681 120

Table 2

COCO evaluation index and significance"

评价指标意义评价指标意义
APIoU=0.5:0.95时的AP值AP50

IoU=0.5时的

AP值

AP75IoU=0.75时的AP值APS小目标的AP值
APM

中等目标的

AP值

APL大目标的AP值

Table 3

Attention-embedded position ablation experiments"

数据

FPNRPNROIhead

mAP

/%

AR

/%

模型权重/MB

TT-

1000K

73.979.8142
75.280.3137
82.483.6137
83.985141

Table 4

Comparative experimental results of different network structures"

模型Mobilenet V2FPNGA-FPN锚选框尺寸更新损失函数优化mAP/%AR/%模型权重/MB
A70.576.6337
B70.675.7239
C73.979.8142
D75.280.3137
E89.587.7136.5
F91.890.8136.5

Fig.7

Comparison chart of test results of selected sample"

Fig.8

Network training loss curve"

Table 5

Comparison of training results of four network models"

网络模型AP50AP75APSAPMAPmAPFPS模型权重Weight size/MB
SSD30051.647.831.643.341.151.658.8142
Mask-RCNN59.851.248.645.643.559.83.5335
Faster-RCNN70.567.450.962.958.670.58.5337
YOLOV3-tiny72.169.153.661.260.172.129.533.6
YOLOv576.972.656.866.363.276.963.714.6
改进后KB-Faster-RCNN91.885.459.679.872.591.816.7136.5
1 Cai Y, Luan T, Gao H, et al. YOLOv4-5D: an effective and efficient object detector for autonomous driving[J]. IEEE Transactions on Instrumentation and Measurement, 2021, 70: 1-13.
2 Wang H, Chen Z, Cai Y, et al. Voxel-RCNN-complex: an effective 3-D point cloud object detector for complex traffic conditions[J]. IEEE Transactions on Instrumentation and Measurement, 2022, 71: 1-12.
3 Wang H, Chen Y, Cai Y, et al. SFNet-N: an improved SFNet algorithm for semantic segmentation of low-light autonomous driving road scenes[J]. IEEE Transactions on Intelligent Transportation Systems, 2022, 23(11): 21405-21417.
4 Chen G, Chen K, Zhang L, et al. VCANet: vanishing-point-guided context-aware network for small road object detection[J]. Automotive Innovation, 2021, 4: 400-412.
5 孟繁星, 于瓅. 基于YOLOv5-EA的交通标志识别[J]. 辽宁工业大学学报: 自然科学版, 2022, 42(5): 303-310.
Meng Fan-xing, Yu Li. Traffic sign recognition based on YOLOv5-EA[J].Journal of Liaoning Institute of Technology(Natural Science Edition), 2022, 42(5): 303-310.
6 田智慧, 孙盐盐, 魏海涛. 基于SSD模型的交通标志检测算法[J]. 计算机应用与软件, 2021, 38(12): 201-206.
Tian Zhi-hui, Sun Yan-yan, Wei Hai-tao. Traffic sign detection algorithm based on ssd model[J]. Computer Applications and Software,2021, 38(12): 201-206.
7 Ayachi R, Afif M, Said Y, et al. Traffic signs detection for real-world application of an advanced driving assisting system using deep learning[J]. Neural Processing Letters, 2020, 51: 837-851.
8 Zhang J, Hui L, Lu J, et al. Attention-based neural network for traffic sign detection[C]∥24th International Conference on Pattern Recognition (ICPR),Beijing,China, 2018: 1839-1844.
9 Fan B B, Yang H. Multi-scale traffic sign detection model with attention[J]. Proceedings of the Institution of Mechanical Engineers, Part D: Journal of Automobile Engineering, 2021, 235(2/3): 708-720.
10 Cao J, Zhang J, Jin X. A traffic-sign detection algorithm based on improved sparse R-CNN[J]. IEEE Access, 2021, 9: 122774-122788.
11 Zhu Z, Liang D, Zhang S, et al. Traffic-sign detection and classification in the wild[C]∥Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition,Las Vegas, USA,2016: 2110-2118.
12 Li H L, Li J, Wei H B, et al. Slim-neck by GSConv: a better design paradigm of detector architectures for autonomous vehicles[J/OL].[2023-05-15].
13 蒋镕圻, 彭月平, 谢文宣, 等. 嵌入scSE模块的改进YOLOv4小目标检测算法[J]. 图学学报, 2021, 42(4): 546-555.
Jiang Rong-qi, Peng Yue-ping, Xie Wen-xuan, et al.Improved YOLOv4 small target detection algorithm with embedded scSE module[J]. Journal of Graphics,2021, 42(4): 546-555.
14 He K, Gkioxari G, Dollár P, et al. Mask R-CNN[C]∥Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy,2017: 2961-2969.
[1] Xiao-ying PAN,De WEI,Yi-zhe ZHAO. Detecetion of lung nodule based on mask R-CNN and contextual convolutional neural network [J]. Journal of Jilin University(Engineering and Technology Edition), 2022, 52(10): 2419-2427.
[2] Hou⁃jie LI,Fa⁃sheng WANG,Jian⁃jun HE,Yu ZHOU,Wei LI,Yu⁃xuan DOU. Pseudo sample regularization Faster R⁃CNN for traffic sign detection [J]. Journal of Jilin University(Engineering and Technology Edition), 2021, 51(4): 1251-1260.
[3] WANG Fang-shi, WANG Jian, LI Bing, WANG Bo. Deep attribute learning based traffic sign detection [J]. 吉林大学学报(工学版), 2018, 48(1): 319-329.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
[1] Ning⁃bo CAO,Li⁃ying ZHAO,Zhao⁃wei QU,Yong⁃heng CHEN,Qiao⁃wen BAI,Xiao⁃lei DENG. Social force model considering bi⁃direction pedestrian slipstreaming behavior[J]. Journal of Jilin University(Engineering and Technology Edition), 2019, 49(3): 688 -694 .
[2] Lu WANG,Yu⁃wen LIU,Hong CHEN. Cross-wind environment vehicle driving feature at canyon bridge and tunnel connection segment[J]. Journal of Jilin University(Engineering and Technology Edition), 2019, 49(3): 736 -748 .
[3] Xiao⁃qin LUO,Dian⁃hai WANG,Sheng JIN. Traffic signal actuated control at isolated intersections for heterogeneous traffic[J]. Journal of Jilin University(Engineering and Technology Edition), 2019, 49(3): 695 -704 .
[4] Qiang TU,Lin CHENG,Fen LIN,Chao SUN. Finding shortest path considering traveler′s risk attitude[J]. Journal of Jilin University(Engineering and Technology Edition), 2019, 49(3): 720 -726 .
[5] CHEN Xin, HU Cui-song, NING Hou-yu, WU Yuan-qiang, WANG Shuo, YANG Chang-hai. Implicit parameterization modeling and multi-performance lightweight optimization for SVU body-in-white[J]. 吉林大学学报(工学版), 2016, 46(6): 1780 -1785 .
[6] Yu ZHAO,Ya⁃fei HUO. Fast equivalent method for vehicle cables under high intensity electromagnetic pulse illumination[J]. Journal of Jilin University(Engineering and Technology Edition), 2019, 49(3): 1009 -1016 .
[7] Qing⁃ying LAI,Jun LIU,Ruo⁃yu ZHAO,Yong⁃ji LUO,Ling⁃yun MENG,Ya⁃zhi XU. Optimal trajectory planning for middle⁃to⁃high speed maglev based on dynamic programming with mutative spacing[J]. Journal of Jilin University(Engineering and Technology Edition), 2019, 49(3): 749 -756 .
[8] Lei ZHANG,Bao⁃guo LIU,Zhao⁃fei CHU. Model test of the influence on shield shaft owing to water loss settlement of deep sandstone aquifer layer[J]. Journal of Jilin University(Engineering and Technology Edition), 2019, 49(3): 788 -797 .
[9] Xiang⁃huan ZU,Chuan⁃lei YANG,He⁃chun WANG,Yin⁃yan WANG. Exhaust gas recirculation performance evaluation of marine diesel engine and its application[J]. Journal of Jilin University(Engineering and Technology Edition), 2019, 49(3): 805 -815 .
[10] Wang Fu-yu,Sha Qing-lin,Zhang Yong,Dai Wen-ting . Application of aggregate gradation test methods of VCADRF and VCAAC for SAC13[J]. 吉林大学学报(工学版), 2007, 37(03): 538 -0543 .