基于Transformer的轮式里程计误差预测模型

doi:10.13229/j.cnki.jdxbgxb20221273

Abstract

Abstract:

To address the problem of unpredictable and variable errors when using wheel odometry for localization， a wheel odometry error prediction model based on Transformer neural network is developed to accurately predict the odometry error that accumulates and changes as the mileage increases， and to improve the accuracy of localization using wheel odometry under GPS occlusion. First， two models were established without and with the driving condition characteristics， then they were compared with the LSTM model under various driving conditions. The experimental results show that the Transformer-based wheel odometry error prediction model can accurately predict the odometry error with higher accuracy， stability and reliability than the LSTM model under both regular driving conditions and challenging driving conditions where it is difficult to measure the odometry signal accurately. At the same time， compared with the Transformer model without considering the driving condition characteristics， the Transformer model with considering the driving condition characteristics improve the performance in all evaluation indexes， which proves that considering the driving condition characteristics can effectively improve the prediction performance of the model.

Key words: vehicle engineering, autonomous driving, localization, wheel odometry, deep learning, Transformer model

CLC Number:

U469.79

Ke HE,Hai-tao DING,Xuan-qi LAI,Nan XU,Kong-hui GUO. Wheel odometry error prediction model based on transformer[J].Journal of Jilin University(Engineering and Technology Edition), 2023, 53(3): 653-662.

Figures/Tables 17

Fig.1

Fig.2

Table 1

Fig.3

Table 2

Table 3

Transformer model training parameters"

参数	IO-VNB数据子集
编码器和解码器个数 $N$	6
子层以及嵌入层的输出维度 $d m o d e l$	64
全连接层中间层层数 $d f f$	32
注意力头数 $h$	8
批量大小	32
训练次数Epochs	100
时间步长（滑动窗口）/s	11
随机失活比例 $D r o p o u t$	0
激活函数	ReLU

Table 3

Table 4

Table 5

Transformer parameter adjustment process"

	N	$d m o d e l$	$d f f$	h	Dropout	max	min	$μ$	$σ$
基准	6	64	32	8	0	1.99	0.03	0.55	0.48
A	6	64	32	4	0	2.11	0.03	0.63	0.50
A	6	64	32	16	0	2.06	0.02	0.60	0.49
B	4	64	32	8	0	2.02	0.04	0.62	0.47
B	8	64	32	8	0	2.10	0.04	0.73	0.53
C	6	32	32	8	0	2.00	0.03	0.66	0.49
C	6	128	32	8	0	1.97	0.03	0.54	0.46
D	6	64	16	8	0	2.02	0.04	0.74	0.50
D	6	64	64	8	0	1.98	0.02	0.58	0.46
E	6	64	32	8	0.1	1.99	0.03	0.83	0.52
E	6	64	32	8	0.2	2.00	0.07	0.82	0.46

Table 5

Table 6

Test results on the motorway scenario"

指标	LSTM模型误差/m	Transformer		模型误差
指标	LSTM模型误差/m	不考虑工况特征	提升/%	考虑工况特征	提升/%
$m a x$	0.68	0.70	-3	0.56	18
$m i n$	0.25	0.10	60	0.05	80
$μ$	0.46	0.34	26	0.30	35
$σ$	0.08	0.12	-50	0.15	-87.5

Table 6

Fig.4

Table 7

Test results on the driving condition with quick changes in vehicle's acceleration"

指标	LSTM模型误差/m	Transformer		模型误差/m
指标	LSTM模型误差/m	不考虑工况特征	提升/%	考虑工况特征	提升/%
$m a x$	2.95	2.00	32	1.99	33
$m i n$	0.54	0.08	85	0.05	91
$μ$	1.40	1.01	28	0.72	49
$σ$	0.79	0.52	34	0.55	30

Table 7

Fig.5

Table 8

Test results on the hard brake scenario"

指标	LSTM模型误差/m	Transformer		模型误差
指标	LSTM模型误差/m	不考虑工况特征	提升/%	考虑工况特征	提升/%
$m a x$	2.93	1.97	33	1.62	45
$m i n$	0.10	0.03	70	0.03	70
$μ$	1.22	0.70	43	0.23	81
$σ$	0.84	0.52	38	0.23	73

Table 8

Fig.6

Table 9

Test results on the wet/muddy road conditions"

指标	LSTM模型误差/m	Transformer		模型误差/m
指标	LSTM模型误差/m	不考虑工况特征	提升/%	考虑工况特征	提升/%
$m a x$	2.33	1.99	15	1.93	17
$m i n$	0.20	0.20	0	0.03	85
$μ$	0.66	0.64	3	0.58	12
$σ$	0.52	0.44	15	0.43	17

Table 9

Fig.7

Fig.8

References 20

1	高振海,孙天骏,何磊. 汽车纵向自动驾驶的因果推理型决策[J]. 吉林大学学报: 工学版, 2019, 49(5): 1392-1404.
	Gao Zhen-hai, Sun Tian-jun, He Lei. Causal reasoning decision⁃making for vehicle longitudinal automatic driving[J]. Journal of Jilin University (Engineering and Technology Edition), 2019, 49(5): 1392-1404.
2	Jo K, Kim J, Kim D, et al. Development of autonomous car—part I: distributed system architecture and development process[J]. IEEE Transactions on Industrial Electronics, 2014, 61(12): 7131-7140.
3	Lu W, Rodríguez F S A, Seignez E, et al. Lane marking-based vehicle localization using low-cost GPS and open source map[J]. Unmanned Systems, 2015, 3(4): 239-251.
4	Xu L H, Hu S G, Luo Q. A new lane departure warning algorithm considering the driver's behavior characteristics[J]. Mathematical Problems in Engineering, 2015(1): No.412126.
5	Levinson J, Montemerlo M, Thrun S. Map-based precision vehicle localization in urban environments[C]∥Robotics: Science and Systems, Atlanta, Georgia, USA, 2007: No.16.
6	秦晓辉, 王哲文, 庞涛, 等. 基于车辆模型紧耦合的封闭园区车辆定位方法[J]. 汽车工程,2021,43(9): 1328-1335.
	Qin Xiao-hui, Wang Zhe-wen, Pang Tao, et al. Vehicle positioning method based on tight coupling of vehicle model in enclosed environments[J]. Automotive Engineering, 2021, 43(9): 1328-1335.
7	Kubo N, Suzuki T. Performance improvement of RTK-GNSS with IMU and vehicle speed sensors in an urban environment[J]. IEICE Transactions on Fundamentals of Electronics, Communications and Computer Sciences, 2016, 99(1): 217-224.
8	何永明, 陈世升, 冯佳, 等. 基于高精地图的超高速公路虚拟轨道系统[J/OL]. [2022-02-15].
9	Funk N, Alatur N, Deuber R, et al. Autonomous electric race car design[J/OL]. [2022-08-26].
10	Schwesinger U, Bürki M, Timpner J, et al. Automated valet parking and charging for e-mobility[C]∥2016 IEEE Intelligent Vehicles Symposium (IV), Gothenburg, Sweden, 2016: 157-164.
11	Schanz A, Spieker A, Kuhnert K D. Autonomous parking in subterranean garages-a look at the position estimation[C]∥IEEE IV2003 Intelligent Vehicles Symposium, OH, USA, 2003: 253-258.
12	Malleswaran M, Vaidehi V, Manjula S, et al. Performance comparison of HONNs and FFNNs in GPS and INS integration for vehicular navigation[C]∥2011 International Conference on Recent Trends in Information Technology (ICRTIT), Chennai, India, 2011: 223-228.
13	Malleswaran M, Vaidehi V, Saravanaselvan A, et al. Performance analysis of various artificial intelligent neural networks for GPS/INS integration[J]. Applied Artificial Intelligence, 2013, 27(5): 367-407.
14	Dai H, Bian H, Wang R, et al. An INS/GNSS integrated navigation in GNSS denied environment using recurrent neural network[J]. Defence Technology, 2020, 16(2): 334-340.
15	Fang W, Jiang J, Lu S, et al. A LSTM algorithm estimating pseudo measurements for aiding INS during GNSS signal outages[J]. Remote Sensing, 2020, 12(2): No.256.
16	Onyekpe U, Palade V, Kanarachos S, et al. Learning uncertainties in wheel odometry for vehicular localisation in GNSS deprived environments[C]∥2020 19th IEEE International Conference on Machine Learning and Applications (ICMLA), Miami, FL, USA, 2020: 741-746.
17	Vaswani A, Shazeer N, Parmar N, et al. Attention is all you need[J/OL]. [2022-09-28].
18	Onyekpe U, Kanarachos S, Palade V, et al. Vehicular localisation at high and low estimation rates during gnss outages: a deep learning approach[J]. Deep Learning Applications, 2021,2: 237-256.
19	Onyekpe U, Palade V, Kanarachos S, et al. IO-VNBD: inertial and odometry benchmark dataset for ground vehicle positioning[J]. Data in Brief, 2021, 35: No.106885.
20	Onyekpe U, Palade V, Kanarachos S. Learning to localise automated vehicles in challenging environments using Inertial Navigation Systems (INS)[J]. Applied Sciences, 2021, 11(3): No.1270.

Related Articles 15

[1]	Deng-feng WANG,Hong-li CHEN,Jing-xin NA,Xin CHEN. Failure comparison of single and double lap joints after high temperature aging [J]. Journal of Jilin University(Engineering and Technology Edition), 2023, 53(2): 346-354.
[2]	Pei ZHANG,Zhi-wei WANG,Chang-qing DU,Fu-wu YAN,Chi-hua LU. Oxygen excess ratio control method of proton exchange membrane fuel cell air system for vehicle [J]. Journal of Jilin University(Engineering and Technology Edition), 2022, 52(9): 1996-2003.
[3]	Ke-yong WANG,Da-tong BAO,Su ZHOU. Data-driven online adaptive diagnosis algorithm towards vehicle fuel cell fault diagnosis [J]. Journal of Jilin University(Engineering and Technology Edition), 2022, 52(9): 2107-2118.
[4]	Qi-ming CAO,Hai-tao MIN,Wei-yi SUN,Yuan-bin YU,Jun-yu JIANG. Hydrothermal characteristics of proton exchange membrane fuel cell start⁃up at low temperature [J]. Journal of Jilin University(Engineering and Technology Edition), 2022, 52(9): 2139-2146.
[5]	Hai-lin KUI,Ze-zhao WANG,Jia-zhen ZHANG,Yang LIU. Transmission ratio and energy management strategy of fuel cell vehicle based on AVL⁃Cruise [J]. Journal of Jilin University(Engineering and Technology Edition), 2022, 52(9): 2119-2129.
[6]	Yan LIU,Tian-wei DING,Yu-peng WANG,Jing DU,Hong-hui ZHAO. Thermal management strategy of fuel cell engine based on adaptive control strategy [J]. Journal of Jilin University(Engineering and Technology Edition), 2022, 52(9): 2168-2174.
[7]	Jin-wu GAO,Zhi-huan JIA,Xiang-yang WANG,Hao XING. Degradation trend prediction of proton exchange membrane fuel cell based on PSO⁃LSTM [J]. Journal of Jilin University(Engineering and Technology Edition), 2022, 52(9): 2192-2202.
[8]	Cheng LI,Hao JING,Guang-di HU,Xiao-dong LIU,Biao FENG. High⁃order sliding mode observer for proton exchange membrane fuel cell system [J]. Journal of Jilin University(Engineering and Technology Edition), 2022, 52(9): 2203-2212.
[9]	Xun-cheng CHI,Zhong-jun HOU,Wei WEI,Zeng-gang XIA,Lin-lin ZHUANG,Rong GUO. Review of model⁃based anode gas concentration estimation techniques of proton exchange membrane fuel cell system [J]. Journal of Jilin University(Engineering and Technology Edition), 2022, 52(9): 1957-1970.
[10]	Yao-wang PEI,Feng-xiang CHEN,Zhe HU,Shuang ZHAI,Feng-lai PEI,Wei-dong ZHANG,Jie-ran JIAO. Temperature control of proton exchange membrane fuel cell thermal management system based on adaptive LQR control [J]. Journal of Jilin University(Engineering and Technology Edition), 2022, 52(9): 2014-2024.
[11]	Guang-di HU,Hao JING,Cheng LI,Biao FENG,Xiao-dong LIU. Multi⁃objective sliding mode control based on high⁃order fuel cell model [J]. Journal of Jilin University(Engineering and Technology Edition), 2022, 52(9): 2182-2191.
[12]	Feng-xiang CHEN,Qi WU,Yuan-song LI,Tian-de MO,Yu LI,Li-ping HUANG,Jian-hong SU,Wei-dong ZHANG. Matching，simulation and optimization for 2.5 ton fuel cell/battery hybrid forklift [J]. Journal of Jilin University(Engineering and Technology Edition), 2022, 52(9): 2044-2054.
[13]	Xiao-hua WU,Zhong-wei YU,Zhang-ling ZHU,Xin-mei GAO. Fuzzy energy management strategy of fuel cell buses [J]. Journal of Jilin University(Engineering and Technology Edition), 2022, 52(9): 2077-2084.
[14]	Qing GAO,Hao-dong WANG,Yu-bin LIU,Shi JIN,Yu CHEN. Experimental analysis on spray mode of power battery emergency cooling [J]. Journal of Jilin University(Engineering and Technology Edition), 2022, 52(8): 1733-1740.
[15]	Kui-yang WANG,Ren HE. Recognition method of braking intention based on support vector machine [J]. Journal of Jilin University(Engineering and Technology Edition), 2022, 52(8): 1770-1776.

Metrics

Viewed

Full text

Abstract

Cited

Shared

Discussed

Comments

Recommended 0

No Suggested Reading articles found!

特征序号	描述	特征序号	描述
1	里程	17	急刹车
2	环岛	18	左右急转弯
3	山路	19	换挡
4	乡村道路	20	打滑
5	高速公路	21	连续左右转
6	市中心	22	短时间加速度快速变化
7	市区内	23	U-turn
8	蜿蜒道路	24	倒车
9	住宅小区	25	漂移
10	山谷	26	碰撞
11	雨	27	Z字形行驶
12	土路	28	近似直线的行驶
13	碎石路	29	静止
14	潮湿道路	30	停车
15	泥路	31	里程误差
16	坑洞

序号	IO-VNB数据子集	序号	IO-VNB数据子集
1	V-Vta1a	14	V-Vtb1
2	V-Vta2	15	V-Vtb2
3	V-Vta8	16	V-Vtb3
4	V-Vta10	17	V-Vtb5
5	V-Vta16	18	V-Vw4
6	V-Vta17	19	V-Vw5
7	V-Vta20	20	V-Vw14b
8	V-Vta21	21	V-Vw14c
9	V-Vta22	22	V-Vfa01
10	V-Vta27	23	V-Vfa02
11	V-Vta28	24	V-Vfb01a
12	V-Vta29	25	V-Vfb01b
13	V-Vta30	26	V-Vfb02b

场景	IO-VNB数据子集	行驶总时间/min	行驶距离/km	速度/（km·h^-1）	加速度/（9.8 m·s^-2）
高速公路	V-Vw12	1.75	2.64	82.6~97.4	-0.06~0.07
加速度快速变化	V-Vfb02e	1.6	1.52	37.4~73.9	-0.24~0.19
加速度快速变化	V-Vta12	1.1	1.27	44.7~85.3	-0.44~0.13
急刹车	V-Vw16b	2.0	1.99	1.3~86.3	-0.75~0.29
	V-Vw17	0.5	0.54	31.5~72.7	-0.8~0.19
	V-Vta9	0.4	0.43	48.9~87.7	-0.6~0.14
湿/泥泞路面	V-Vtb8	1.2	1.35	60.9~76.5	-0.35~0.08
	V-Vtb11	0.7	0.84	5.1~75.3	-0.05~0.12
	V-Vtb13	2.1	0.99	7.5~43.3	-0.31~0.22

Wheel odometry error prediction model based on transformer

RICH HTML

PDF (PC)