Journal of Jilin University(Engineering and Technology Edition) ›› 2023, Vol. 53 ›› Issue (3): 663-673.doi: 10.13229/j.cnki.jdxbgxb20220895

Previous Articles    

Enhanced localization system based on camera and lane markings

Ke HE(),Hai-tao DING,Nan XU,Kong-hui GUO   

  1. College of Automotive Engineering，Jilin University，Changchun 130022，China
  • Received:2022-07-13 Online:2023-03-01 Published:2023-03-29

RICH HTML

 13   

PDF (PC)

476

Abstract:

In the traditional technology of lateral localization using lane markings identified by cameras， incorrect matching of lanes or their left and right boundary points causes large localization errors under driving conditions such as lane changing. A multi-indicator weighted evaluation map matching algorithm combined with lane change recognition method was proposed. Further， a lane left and right boundary point determination method was designed， and a camera-based bilateral boundary line lateral localization method was proposed based on accurate matching to lanes and their boundary points， which can improve the lateral localization accuracy relative to lanes， and then fuse the camera with GPS， IMU， wheel odometer， and lightweight lane level map to form a complete localization system. The experimental results show that the accuracy and stability are significantly improved compared with the traditional fusion localization method using cameras and lane markings. The localization system designed in this paper provides a low-cost and high-accuracy solution for autonomous driving localization.

Key words: vehicle engineering, camera, lane marking, sensor fusion, localization, map matching

CLC Number: 

  • U469.79

Fig.1

Diagram of lane boundary points and boundary lines"

Fig.2

Framework of the localization system"

Fig.3

Two-wheel odometer model"

Fig.4

Simulation experiment： trajectory and change of C0 of left and right lane markings when vehicle changes lanes left first and then right"

Fig.5

Determination algorithm about left and right boundary points on the lane"

Fig.6

Schematic diagram of camera-based lateral localization of bilateral boundaries"

Fig.7

Schematic diagram of localization using left and right boundary lines"

Fig.8

Camera-based lateral localization effect of bilateral boundaries"

Fig.9

Driving scene where four roads intersect at an intersection"

Table 1

Parameter settings in the simulation"

参数误差均值误差标准差
x坐标/m01.5
y坐标/m01.5
航向角/rad00.1
横摆角速度/（rad·s-1）00.01
车速/（m·s-1）00.3

Fig.10

Double lane change simulation scenario"

Fig.11

Complete route trajectory"

Fig.12

Comparison of experimental trajectories of the double lane change"

Fig.13

Comparison of lateral errors of driving on the road"

Fig.14

Comparison between heading errors of algorithms"

Table 2

Comparison of localization results"

方法指标均值标准差
GPS+IMU+轮式里程计侧向误差/m0.330.62
整体误差/m0.580.82
航向角误差/rad0.0030.048
文献［16］算法侧向误差/m0.300.66
整体误差/m0.570.88
航向角误差/rad0.0070.126
本文算法侧向误差/m0.030.18
整体误差/m0.340.67
航向角误差/rad0.0030.048

Fig.15

Map matching effect in double lane change"

Table 3

Comparison of map matching results"

方法总体匹配正确率/%
GPS点对点匹配89.8
文献［16］使用算法93.6
本文算法97.8

Fig.16

Constructed driving scenario and selected test route （with colors highlighting the roads to be traveled）"

Fig.17

Test results on the whole route"

Table 4

Comparison of localization results"

算法指标均值标准差
文献［16］定位误差/m2.303.03
航向角误差/rad0.0170.462
本文定位误差/m0.771.69
航向角误差/rad0.0090.176
1 高振海, 孙天骏, 何磊. 汽车纵向自动驾驶的因果推理型决策[J]. 吉林大学学报: 工学版, 2019, 49(5): 1392-1404.
Gao Zhen-hai, Sun Tian-jun, He Lei. Causal reasoning decision⁃making for vehicle longitudinal automatic driving[J]. Journal of Jilin University (Engineering and Technology Edition), 2019, 49(5): 1392-1404.
2 Jo K, Kim J, Kim D, et al. Development of autonomous car-part I: distributed system architecture and development process[J]. IEEE Transactions on Industrial Electronics, 2014, 61(12): 7131-7140.
3 Lu W, Rodríguez F S A, Seignez E, et al. Lane marking-based vehicle localization using low-cost GPS and open source map[J]. Unmanned Systems, 2015, 3(4): 239-251.
4 Xu L H, Hu S G, Luo Q. A new lane departure warning algorithm considering the driver's behavior characteristics[J]. Mathematical Problems in Engineering, 2015, 8: 1-11.
5 Levinson J, Montemerlo M, Thrun S.Map-based precision vehicle localization in urban environments[J]. Robotics: Science and Systems, 2007, 3: 121-128.
6 秦晓辉, 王哲文, 庞涛, 等. 基于车辆模型紧耦合的封闭园区车辆定位方法[J]. 汽车工程, 2021, 43(9):1328-1335.
Qin Xiao-hui, Wang Zhe-wen, Pang Tao, et al. Vehicle positioning method based on tight coupling of vehicle model in enclosed environments[J]. Automotive Engineering, 2021, 43(9): 1328-1335.
7 Kubo N, Suzuki T. Performance improvement of RTK-GNSS with IMU and vehicle speed sensors in an urban environment[J]. IEICE Transactions on Fundamentals of Electronics, Communications and Computer Sciences, 2016, 99(1): 217-224.
8 何永明, 陈世升, 冯佳, 等. 基于高精地图的超高速公路虚拟轨道系统[J/OL]. [2022-07-03].
9 Hata A Y, Wolf D F. Feature detection for vehicle localization in urban environments using a multilayer LIDAR[J]. IEEE Transactions on Intelligent Transportation Systems, 2015, 17(2): 420-429.
10 Castorena J, Agarwal S. Ground-edge-based LIDAR localization without a reflectivity calibration for autonomous driving[J]. IEEE Robotics and Automation Letters, 2017, 3(1): 344-351.
11 Wolcott R W, Eustice R M. Robust LIDAR localization using multiresolution Gaussian mixture maps for autonomous driving[J]. The International Journal of Robotics Research, 2017, 36(3): 292-319.
12 Rose C, Britt J, Allen J, et al. An integrated vehicle navigation system utilizing lane-detection and lateral position estimation systems in difficult environments for GPS[J]. IEEE Transactions on Intelligent Transportation Systems, 2014, 15(6): 2615-2629.
13 Tao Z, Bonnifait P, Fremont V, et al. Mapping and localization using GPS, lane markings and proprioceptive sensors[C]∥2013 IEEE/RSJ International Conference on Intelligent Robots and Systems, Tokyo, Japan, 2013: 406-412.
14 Tao Z, Bonnifait P, Fremont V, et al. Lane marking aided vehicle localization[C]∥16th International IEEE Conference on Intelligent Transportation Systems, Hague, Netherlands, 2013: 1509-1515.
15 El Najjar M E, Bonnifait P. A road-matching method for precise vehicle localization using belief theory and kalman filtering[J]. Autonomous Robots, 2005, 19(2): 173-191.
16 Tao Z, Bonnifait P, Frémont V, et al. Road‐centered map‐aided localization for driverless cars using single‐frequency GNSS receivers[J]. Journal of Field Robotics, 2017, 34(5): 1010-1033.
17 Mohamed S A S, Haghbayan M H, Westerlund T, et al. A survey on odometry for autonomous navigation systems[J]. IEEE Access, 2019, 7: 97466-97486.
18 Hashemi M, Karimi H A. A critical review of real-time map-matching algorithms: current issues and future directions[J]. Computers, Environment and Urban Systems, 2014, 48: 153-165.
19 Zhao X, Cheng X, Zhou J, et al. Advanced topological map matching algorithm based on D-S theory[J]. Arabian Journal for Science and Engineering, 2018, 43(8): 3863-3874.
20 Hansson A, Korsberg E, Maghsood R, et al. Lane-level map matching based on HMM[J]. IEEE Transactions on Intelligent Vehicles, 2020, 6(3): 430-439.
21 That T N, Casas J. An integrated framework combining a traffic simulator and a driving simulator[J]. Procedia-Social and Behavioral Sciences, 2011, 20: 648-655.
22 Kanakagiri A. Development of a virtual simulation environment for autonomous driving using digital twins[D]. Ingolstadt: Technische Hochschule Ingolstadt International Automotive Engineering, 2021.
[1] Ke HE,Hai-tao DING,Xuan-qi LAI,Nan XU,Kong-hui GUO. Wheel odometry error prediction model based on transformer [J]. Journal of Jilin University(Engineering and Technology Edition), 2023, 53(3): 653-662.
[2] Deng-feng WANG,Hong-li CHEN,Jing-xin NA,Xin CHEN. Failure comparison of single and double lap joints after high temperature aging [J]. Journal of Jilin University(Engineering and Technology Edition), 2023, 53(2): 346-354.
[3] Pei ZHANG,Zhi-wei WANG,Chang-qing DU,Fu-wu YAN,Chi-hua LU. Oxygen excess ratio control method of proton exchange membrane fuel cell air system for vehicle [J]. Journal of Jilin University(Engineering and Technology Edition), 2022, 52(9): 1996-2003.
[4] Ke-yong WANG,Da-tong BAO,Su ZHOU. Data-driven online adaptive diagnosis algorithm towards vehicle fuel cell fault diagnosis [J]. Journal of Jilin University(Engineering and Technology Edition), 2022, 52(9): 2107-2118.
[5] Qi-ming CAO,Hai-tao MIN,Wei-yi SUN,Yuan-bin YU,Jun-yu JIANG. Hydrothermal characteristics of proton exchange membrane fuel cell start⁃up at low temperature [J]. Journal of Jilin University(Engineering and Technology Edition), 2022, 52(9): 2139-2146.
[6] Hai-lin KUI,Ze-zhao WANG,Jia-zhen ZHANG,Yang LIU. Transmission ratio and energy management strategy of fuel cell vehicle based on AVL⁃Cruise [J]. Journal of Jilin University(Engineering and Technology Edition), 2022, 52(9): 2119-2129.
[7] Yan LIU,Tian-wei DING,Yu-peng WANG,Jing DU,Hong-hui ZHAO. Thermal management strategy of fuel cell engine based on adaptive control strategy [J]. Journal of Jilin University(Engineering and Technology Edition), 2022, 52(9): 2168-2174.
[8] Cheng LI,Hao JING,Guang-di HU,Xiao-dong LIU,Biao FENG. High⁃order sliding mode observer for proton exchange membrane fuel cell system [J]. Journal of Jilin University(Engineering and Technology Edition), 2022, 52(9): 2203-2212.
[9] Xun-cheng CHI,Zhong-jun HOU,Wei WEI,Zeng-gang XIA,Lin-lin ZHUANG,Rong GUO. Review of model⁃based anode gas concentration estimation techniques of proton exchange membrane fuel cell system [J]. Journal of Jilin University(Engineering and Technology Edition), 2022, 52(9): 1957-1970.
[10] Yao-wang PEI,Feng-xiang CHEN,Zhe HU,Shuang ZHAI,Feng-lai PEI,Wei-dong ZHANG,Jie-ran JIAO. Temperature control of proton exchange membrane fuel cell thermal management system based on adaptive LQR control [J]. Journal of Jilin University(Engineering and Technology Edition), 2022, 52(9): 2014-2024.
[11] Guang-di HU,Hao JING,Cheng LI,Biao FENG,Xiao-dong LIU. Multi⁃objective sliding mode control based on high⁃order fuel cell model [J]. Journal of Jilin University(Engineering and Technology Edition), 2022, 52(9): 2182-2191.
[12] Feng-xiang CHEN,Qi WU,Yuan-song LI,Tian-de MO,Yu LI,Li-ping HUANG,Jian-hong SU,Wei-dong ZHANG. Matching，simulation and optimization for 2.5 ton fuel cell/battery hybrid forklift [J]. Journal of Jilin University(Engineering and Technology Edition), 2022, 52(9): 2044-2054.
[13] Xiao-hua WU,Zhong-wei YU,Zhang-ling ZHU,Xin-mei GAO. Fuzzy energy management strategy of fuel cell buses [J]. Journal of Jilin University(Engineering and Technology Edition), 2022, 52(9): 2077-2084.
[14] Qing GAO,Hao-dong WANG,Yu-bin LIU,Shi JIN,Yu CHEN. Experimental analysis on spray mode of power battery emergency cooling [J]. Journal of Jilin University(Engineering and Technology Edition), 2022, 52(8): 1733-1740.
[15] Kui-yang WANG,Ren HE. Recognition method of braking intention based on support vector machine [J]. Journal of Jilin University(Engineering and Technology Edition), 2022, 52(8): 1770-1776.
Viewed
Full text


Abstract

Cited
  Shared   
  Discussed   
No Suggested Reading articles found!
Copyright © Journal of Jilin University(Engineering and Technology Edition), All Rights Reserved.
Tel: +86-431-85095297　Fax: +86-431-85094074　E-mail: xbgxb@jlu.edu.cn
Powered by Beijing Magtech Co. Ltd