Journal of Jilin University(Engineering and Technology Edition) ›› 2025, Vol. 55 ›› Issue (3): 954-962.doi: 10.13229/j.cnki.jdxbgxb.20231228

Previous Articles     Next Articles

Traffic accident anticipation baed on spatial-temporal relational learning and convolutional gated recurrent network

Sheng JIANG1(),Yi-di WANG1,Rui-lin XIE1,Miao-lei XIA2()   

  1. 1.College of Physics,Changchun University of Science and Technology,Changchun 130022,China
    2.College of Architecture and Energy Engineering,Wenzhou University of Technology,Wenzhou 325035,China
  • Received:2023-11-09 Online:2025-03-01 Published:2025-05-20
  • Contact: Miao-lei XIA E-mail:js1985_cust@163.com;240654931@qq.com

Abstract:

To predict the possibility of traffic accidents in advance, a traffic accident risk anticipation model gated recurrent unit spatial-temporal transformer(GST) was established based on the combination of vision transformer(ViT), gated recurrent unit (GRU), and MLP-Mixer. By modeling spatial-temporal relational learning through ViT, the frame features of predicted targets were enhanced to improve their distinguishability. On this basis, GRU was used to extract temporal relational, and then GRU and MLP-Mixer were combined to enhance the hidden layer frame features, establishing and optimizing spatiotemporal relational, the confidence score of traffic accidents for each time step was predicted based on the corresponding feature frames to predict the probability of future accidents and effectively distinguish between dangerous driving and accident driving behavior. Finally, the proposed model was validated on the public datasets DAD and A3D, and the results showed that the recognition accuracy of the proposed model was superior to other advanced algorithms. The AP on the two datasets reached 59.9% and 94.6%, respectively, demonstrating good predictive performance and generalization ability. In the DAD dataset, the algorithm proposed was compared to the DSTA model. With similar AP, the proposed algorithm can advance the prediction time of accidents by 2.38 seconds, an increase of about 13%. This indicates a significant advantage and provides assistance for road hazard warnings and safe driving.

Key words: intelligent transportation, accident anticipation, event discriminator, gated recurrent unit, spatial-temporal relational

CLC Number: 

  • TP301.6

Fig.1

Overview of the GST accident prediction model"

Fig.2

Overview of the FET module"

Fig.3

Examples of different variants predictions on DAD datasets"

Table 1

Ablation study on the DAD dataset"

实验RNNFETMLP-MixerAP/%mTTA/s
1GRU69.331.53
2GRU68.751.44
3LSTM69.851.49
4GRU73.121.51

Fig.4

Prediction results of different models with miss agents"

Table 2

Comparison with other models on DAD and A3D dataset"

数据集模型mTTA/sAP/%
DAD7DSA71.3448.1
DSTA82.0759.2
GST2.3859.9
A3D19DSA72.9592.3
GST2.4294.6
1 刘嫣然, 孟庆瑜, 郭洪艳, 等.图注意力模式下融合高精地图的周车轨迹预测[J]. 吉林大学学报: 工学版, 2023, 53(3): 792-801.
Liu Yan-ran, Meng Qing-yu, Guo Hong-yan, et al. Vehicle trajectory prediction combined with high definition map in graph attention mode[J]. Journal of Jilin University (Engineering and Technology Edition), 2023,53(3):792-801.
2 田彦涛, 黄兴, 卢辉遒, 等. 基于注意力与深度交互的周车多模态行为轨迹预测[J]. 吉林大学学报: 工学版, 2023, 53(5): 1474-1480.
Tian Yan-tao, Huang xing, Lu Hui-qiu, et al. Multi⁃mode behavior trajectory prediction of surrounding vehicle based on attention and depth interaction[J]. Journal of Jilin University (Engineering and Technology Edition), 2023,53(5): 1474-1480.
3 田彦涛, 许富强, 王凯歌, 等.考虑周车信息的自车期望轨迹预测[J]. 吉林大学学报: 工学版, 2023,53(3): 674-681.
Tian Yan-tao, Xu Fu-qiang, Wang Kai-ge, et al. Expected trajectory prediction of vehicle considering surrounding vehicle information[J]. Journal of Jilin University (Engineering and Technology Edition), 2023, 53(3): 674-681.
4 李志慧, 孙雅倩, 陶鹏飞, 等. 交通事故后的交通运行风险状态等级预测方法[J]. 吉林大学学报: 工学版, 2022, 52(1): 127-135.
Li Zhi-hui, Sun Ya-qian, Tao Peng-fei, et al. Prediction method of traffic operation risk level after traffic accident[J]. Journal of Jilin University (Engineering and Technology Edition), 2022,52(1):127-135.
5 Karim M M, Li Y, Qin R. Towards explainable artificial intelligence (XAI) for early anticipation of traffic accidents[J/OL].[2023-10-20].
6 Wu X X, Zhao J W, Wang R Q. Anticipating future relations via graph growing for action prediction[J]AAAI Technical Track on Computer Vision III, 2021, 35(4): 2952-2960.
7 Chan F H, Chen Y T, Xiang Y, et al. Anticipating accidents in dashcam videos[C]∥Computer Vision–ACCV 2016: 13th Asian Conference on Computer Vision, Taipei, Taiwan,China, 2017: 136-153.
8 Karim M M, Li Y, Qin R, et al. A dynamic spatial-temporal attention network for early anticipation of traffic accidents[J]. IEEE Transactions on Intelligent Transportation Systems, 2022, 23(7): 9590-9600.
9 Fatima M, Khan M U K, Kyung C M. Global feature aggregation for accident anticipation[C]∥2020 25th International Conference on Pattern Recognition (ICPR),Milan, Italy, 2021: 2809-2816.
10 Kang M, Lee W, Hwang K, et al. Vision transformer for detecting critical situations and extracting functional scenario for automated vehicle safety assessment[J]. Sustainability, 2022, 14(15): No.9680.
11 Dosovitskiy A, Beyer L, Kolesnikov A, et al. An image is worth 16x16 words: transformers for image recognition at scale[J/OL].[2023-10-20].
12 张玺君, 余光杰, 崔勇, 等.基于聚类算法和图神经网络的短时交通流预测[J]. 吉林大学学报: 工学版, 2024, 54(6): 1593-1600.
Zhang Xi-jun, Yu Guang-Jie, Cui yong, et al. Short-term traffic flow prediction based on clustering algorithm and Graph neural network[J]. Journal of Jilin University (Engineering and Technology Edition), 2024, 54(6): 1593-1600.
13 Zhao L, Song Y, Zhang C, et al. T-GCN: a temporal graph convolutional network for traffic prediction[J]. IEEE Transactions on Intelligent Transportation Systems, 2019, 21(9): 3848-3858.
14 Bao W, Yu Q, Kong Y. Uncertainty-based traffic accident anticipation with spatio-temporal relational learning[J/OL]. [2023-10-22]. Computer Vision and Pattern Recognition,
15 Fusco F, Pascual D, Staar P. pNLP-Mixer: an efficient all-MLP architecture for language[J/OL].[2023-10-22].
16 Ren S, He K, Girshick R, et al. Faster R-CNN: Towards real-time object detection with region proposal networks[J/OL].[2023-10-22].
17 Wojke N, Bewley A, Paulus D. Simple online and realtime tracking with a deep association metric[C]∥2017 IEEE international conference on image processing (ICIP), Beijing, China, 2017: 3645-3649.
18 Vaswani A, Shazeer N, Parmar N, et al. Attention is all you need[J]. Advances in Neural Information Processing Systems, 2017, 30: 5998-6008.
19 张龙, 徐天鹏, 王朝兵, 等.基于卷积门控循环网络的齿轮箱故障诊断[J]. 吉林大学学报: 工学版,2022, 52(2): 368-376.
Zhang Long, Xu Tian-peng, Wang Chao-bing, et al. Gearbox fault diagnosis baed on convolutional gated recurrent network[J]. Journal of Jilin University (Engineering and Technology Edition), 2022, 52(2):368-376.
20 Yao Y, Xu M, Wang Y, et al. Unsupervised traffic accident detection in first-person videos[C]∥2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Macau, China, 2019: 273-280.
21 Wang T, Chen K, Chen G, et al. GSC: A Graph and Spatio-temporal Continuity Based Framework for Accident Anticipation[J]. IEEE Transactions on Intelligent Vehicles, 2024, 9(1): 2294-2261.
[1] Li LI,Yu-jian BAO,Wen-chen YANG,Qing-ling CHU,Gui-ping WANG. Standardized constructing method of a roadside multi-source sensing dataset [J]. Journal of Jilin University(Engineering and Technology Edition), 2025, 55(2): 529-536.
[2] Nan YANG,Jun XIAO. Energy saving optimization control of urban intelligent transportation under sequential quadratic programming algorithm [J]. Journal of Jilin University(Engineering and Technology Edition), 2024, 54(8): 2223-2228.
[3] Li LI,Xiao-qiang WU,Wen-chen YANG,Rui-jie ZHOU,Gui-ping WANG. Target recognition and tracking of group vehicles based on roadside millimeter-wave radar [J]. Journal of Jilin University(Engineering and Technology Edition), 2024, 54(7): 2104-2114.
[4] Xi-jun ZHANG,Guang-jie YU,Yong CUI,Ji-yang SHANG. Short-term traffic flow prediction based on clustering algorithm and graph neural network [J]. Journal of Jilin University(Engineering and Technology Edition), 2024, 54(6): 1593-1600.
[5] Pei-guang JING,Yu-dou TIAN,Shao-chu WANG,Yun LI,Yu-ting SU. Traffic flow prediction algorithm based on dynamic diffusion graph convolution [J]. Journal of Jilin University(Engineering and Technology Edition), 2024, 54(6): 1582-1592.
[6] Xiu-jian YANG,Xiao-han JIA,Sheng-bin ZHANG. Characteristics of mixed traffic flow taking account effect of dynamics of vehicular platoon [J]. Journal of Jilin University(Engineering and Technology Edition), 2024, 54(4): 947-958.
[7] Yan-tao TIAN,Xing HUANG,Hui-qiu LU,Kai-ge WANG,Fu-qiang XU. Multi⁃mode behavior trajectory prediction of surrounding vehicle based on attention and depth interaction [J]. Journal of Jilin University(Engineering and Technology Edition), 2023, 53(5): 1474-1480.
[8] Hui-zhen ZHANG,Zheng-kai GAO,Jian-qiang LI,Chen-xi WANG,Yu-biao PAN,Cheng WANG,Jing WANG. Short⁃term passenger flow forecasting of urban rail transit based on recurrent neural network [J]. Journal of Jilin University(Engineering and Technology Edition), 2023, 53(2): 430-438.
[9] Hai-long GAO,Yi-bo XU,De-zao HOU,Xue-song WANG. Shortterm traffic flow prediction algorithm for road network based on deep asynchronous residual network [J]. Journal of Jilin University(Engineering and Technology Edition), 2023, 53(12): 3458-3464.
[10] Ming-hua GAO,Can YANG. Traffic target detection method based on improved convolution neural network [J]. Journal of Jilin University(Engineering and Technology Edition), 2022, 52(6): 1353-1361.
[11] Long ZHANG,Tian-peng XU,Chao-bing WANG,Jian-yu YI,Can-zhuang ZHEN. Gearbox fault diagnosis baed on convolutional gated recurrent network [J]. Journal of Jilin University(Engineering and Technology Edition), 2022, 52(2): 368-376.
[12] Xian-yan KUANG,Hui-chao LUO,Rui ZHONG,Peng OUYANG. Bus arrival time prediction based on wavelet neural network optimized by Beetle Antennae Search [J]. Journal of Jilin University(Engineering and Technology Edition), 2022, 52(1): 110-117.
[13] Jian ZHANG,Kun-run WU,Min YANG,Bin RAN. Double⁃ring adaptive control model of intersection during intelligent and connected environment [J]. Journal of Jilin University(Engineering and Technology Edition), 2021, 51(2): 541-548.
[14] ZHAO Hong-wei, LIU Yu-qi, DONG Li-yan, WANG Yu, LIU Pei. Dynamic route optimization algorithm based on hybrid in ITS [J]. 吉林大学学报(工学版), 2018, 48(4): 1214-1223.
[15] PAN Yi-yong, MA Jian-xiao, SUN Lu. Optimal path in dynamic network with random link travel times based on reliability [J]. 吉林大学学报(工学版), 2016, 46(2): 412-417.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!