Journal of Jilin University(Engineering and Technology Edition) ›› 2023, Vol. 53 ›› Issue (5): 1474-1480.doi: 10.13229/j.cnki.jdxbgxb.20210904

Previous Articles    

Multi⁃mode behavior trajectory prediction of surrounding vehicle based on attention and depth interaction

Yan-tao TIAN1,2(),Xing HUANG1,Hui-qiu LU1,Kai-ge WANG1,Fu-qiang XU1   

  1. 1.College of Communication Engineering,Jilin University,Changchun 130022,China
    2.Key Laboratory of Bionic Engineering,Ministry of Education,Jilin University,Changchun 130022,China
  • Received:2021-09-09 Online:2023-05-01 Published:2023-05-25

Abstract:

A vehicle deep-interaction coding model combined with a decoder based on the attention-mechanism to solve this problem was presented in this work. The model's multi-modal behavior predictions and trajectory predictions were output. The proposed model is evaluated by the public NGSIM US-101 and I-80 data sets. The results show that the model has a better root mean square error and achieves higher trajectory prediction accuracy while improving computational efficiency. This paper also shows a qualitative analysis of the prediction of multi-modal behavior maneuvering.

Key words: vehicle engineering, trajectory prediction, multimodal prediction, attention mechanism, gated recurrent unit

CLC Number: 

  • U495

Fig.1

Reference coordinate system and driving behavior set"

Fig.2

A deeply interactive GRU model based on attention mechanism"

Fig.3

Structure of GRU"

Fig.4

I-80 area in NGSIM datasate"

Table 1

RMSE values of different models"

模 型预测时间/s
12345
V-LSTM0.681.652.914.466.27
C-VGMM+VIM0.661.562.754.246.68
CS-LSTM0.651.342.403.564.54
DCS-LSTM0.581.262.213.464.43
ADI-DCS-GRU0.551.242.103.124.23
ADI-DCS-GRU(M)0.571.262.153.234.35

Fig.5

Negative logarithmic likelihood error"

Fig.6

Analysis of the prediction in lane change process"

Fig.7

Influence of surrounding vehicles on trajectory prediction of multimodal behavior"

1 Lefèvre S, Vasquez D, Laugier C. A survey on motion prediction and risk assessment for intelligent vehicles [J]. Robomech Journal, 2014, 1(1): 1-14.
2 Ammous S, Nashashibi F. Real time trajectory prediction for collision risk estimation between vehicles [C]∥IEEE 5th Internationgal Conference on Intelligent Computer Communication and Proceding, Cluj-Napoca, Romania, 2009: 417-422.
3 Broadhurst A, Baker S, Kanade T. Monte carlo road safety reasoning[C]∥IEEE Intelligent Vehicles Symposium Proceedings,Las Vegas,USA,2005: 319-324.
4 Schreier M, Willert V, Adamy J. An integrated approach to maneuver-based trajectory prediction and criticality assessment in arbitrary road environments[J]. IEEE Transactions on Intelligent Transportation Systems, 2016, 17(10): 2751-2766.
5 Zhang H, Geiger A, Urtasun R. Understanding high-level semantics by modeling traffic patterns[C]∥IEEE International Conference on Computer Vision, Sydney, Australia, 2013: 3056-3063.
6 Lefèvre S, Laugier C, Ibaez-Guzmàn J. Intention-aware risk estimation for general traffic situations, and application to intersection safety[J]. Hal Inria, 2013, 8379: 1-23.
7 Deo N, Rangesh A, Trivedi M M. How would surround vehicles move? a unified framework for maneuver classification and motion prediction[J]. IEEE Transactions on Intelligent Vehicles, 2018, 3(2): 129-140.
8 Lee D, Kwon Y P, Mcmains S. Convolution neural network-based lane change intention prediction of surrounding vehicles for ACC[C]∥IEEE 20th International Conference on Intelligent Transportation Systems, Yokohama, Japan, 2017: 1-6.
9 Khosroshahi A, Ohn-Bar E, Trivedi M M. Surround vehicles trajectory analysis with recurrent neural networks[C]∥IEEE International Conference on Intelligent Transportation Systems, Rio de Janeiro, Cluj-Napoca, Romania, 2016: 2267-2272.
10 Phillps D J, Wheeler T A, Kochenderfer M J. Generalizable intention prediction of human drivers at intersections [C]∥IEEE Intelligent Vehicles Symposium (IV), Redondo Beach, USA, 2017: 1665-1670.
11 Kim B, Kang C M, Kim J. Probabilistic vehicle trajectory prediction over occupancy grid map via recurrent neural network [C]∥IEEE 20th International Conference on Intelligent Transportation Systems, Yokohama, Japan, 2017: 399-404.
12 Lee N, Choi W, Vernaza P. DESIRE: distant future prediction in dynamic scenes with interacting agents[C]∥IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, USA, 2017: 2165-2174.
13 Deo N, Trivedi M M. Convolutional social pooling for vehicle trajectory prediction[C]∥IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, Salt Lake City, USA, 2018: 1549-1557.
14 Deo N, Trivedi M M. Multi-modal trajectory prediction of surrounding vehicles with maneuver based LSTMs[C]∥IEEE Intelligent Vehicles Symposium, Changshu, China, 2018: 1179-1184.
15 Zhang H, Wang Y, Liu J. A multi-modal states based vehicle descriptor and dilated convolutional social pooling for vehicle trajectory prediction[J]. SAE Technical Papers, arXiv: .
16 Alexiadis V, Colyar J, Halkias J. The next generation simulation program[J]. ITE Journal, 2004, 74(8): 22-26.
17 Thiemann C, Treiber M, Kesting A. Estimating acceleration and lane-changing dynamics based on NGSIM trajectory data[J]. Transportation Research Record Journal of the Transportation Research Board, 2008(2088): 90-101.
[1] Lei CHEN,Yang WANG,Zhi-sheng DONG,Ya-qi SONG. A vehicle agility control strategy based on steering intent [J]. Journal of Jilin University(Engineering and Technology Edition), 2023, 53(5): 1257-1263.
[2] Xin CHEN,Guan-chen ZHANG,Kang-ming ZHAO,Jia-ning WANG,Li-fei YANG,De-rong SITU. Influence of lap welds on the lightweight design of welded aluminum structures [J]. Journal of Jilin University(Engineering and Technology Edition), 2023, 53(5): 1282-1288.
[3] Yong ZHANG,Feng-zhao MAO,Shui-chang LIU,Qing-yu WANG,Shen-gong PAN,Guang-sheng ZENG. Optimization on distortion grid of vehicle external flow field based on Laplacian Algorithm [J]. Journal of Jilin University(Engineering and Technology Edition), 2023, 53(5): 1289-1296.
[4] Shao-hua WANG,Kun CHU,De-hua SHI,Chun-fang YIN,Chun LI. Robust compound coordinated control of HEV based on finite⁃time extended state observation [J]. Journal of Jilin University(Engineering and Technology Edition), 2023, 53(5): 1272-1281.
[5] Gui-shen YU,Xin CHEN,Zi-tao WU,Yi-xiong CHEN,Guan-chen ZHANG. Analysis of microstructure and mechanical properties of probeless friction stir spot welding joint in AA6061⁃T6 aluminum thin plate [J]. Journal of Jilin University(Engineering and Technology Edition), 2023, 53(5): 1338-1344.
[6] Hong-bo YANG,Wen-ku SHI,Zhi-yong CHEN,Nian-cheng GUO,Yan-yan ZHAO. Multi⁃objective optimization of macro parameters of helical gear based on NSGA⁃Ⅱ [J]. Journal of Jilin University(Engineering and Technology Edition), 2023, 53(4): 1007-1018.
[7] Rui ZHAO,Yun LI,Hong-yu HU,Zhen-hai GAO. Vehicle collision warning method at intersection based on V2I communication [J]. Journal of Jilin University(Engineering and Technology Edition), 2023, 53(4): 1019-1029.
[8] Xiao-bo CHEN,Ling CHEN. Variational Bayesian cooperative target tracking with unknown localization noise statistics [J]. Journal of Jilin University(Engineering and Technology Edition), 2023, 53(4): 1030-1039.
[9] Wei LYU,Jia-ze HAN,Jing-hui CHU,Pei-guang JING. Multi⁃modal self⁃attention network for video memorability prediction [J]. Journal of Jilin University(Engineering and Technology Edition), 2023, 53(4): 1211-1219.
[10] Ke HE,Hai-tao DING,Xuan-qi LAI,Nan XU,Kong-hui GUO. Wheel odometry error prediction model based on transformer [J]. Journal of Jilin University(Engineering and Technology Edition), 2023, 53(3): 653-662.
[11] Yan-ran LIU,Qing-yu MENG,Hong-yan GUO,Jia-lin LI. Vehicle trajectory prediction combined with high definition map in graph attention mode [J]. Journal of Jilin University(Engineering and Technology Edition), 2023, 53(3): 792-801.
[12] Yan-tao TIAN,Yan-shi JI,Huan CHANG,Bo XIE. Deep reinforcement learning augmented decision⁃making model for intelligent driving vehicles [J]. Journal of Jilin University(Engineering and Technology Edition), 2023, 53(3): 682-692.
[13] Jian ZHANG,Jin-bo LIU,Yuan GAO,Meng-ke LIU,Zhen-hai GAO,Bin YANG. Localization algorithm of vehicular sensor based on multi⁃mode interaction [J]. Journal of Jilin University(Engineering and Technology Edition), 2023, 53(3): 772-780.
[14] Bo XIE,Rong GAO,Fu-qiang XU,Yan-tao TIAN. Stability control of human⁃vehicle shared steering system under low adhesion road conditions [J]. Journal of Jilin University(Engineering and Technology Edition), 2023, 53(3): 713-725.
[15] Yan-tao TIAN,Fu-qiang XU,Kai-ge WANG,Zi-xu HAO. Expected trajectory prediction of vehicle considering surrounding vehicle information [J]. Journal of Jilin University(Engineering and Technology Edition), 2023, 53(3): 674-681.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!