Journal of Jilin University(Engineering and Technology Edition) ›› 2025, Vol. 55 ›› Issue (5): 1638-1647.doi: 10.13229/j.cnki.jdxbgxb.20230908

Previous Articles     Next Articles

Deep deterministic policy gradient caching method for privacy protection in Internet of Vehicles

Zi-hao SHEN1(),Yong-sheng GAO1,Hui WANG2(),Pei-qian LIU2,Kun LIU2   

  1. 1.School of Computer Science and Technology,Henan Polytechnic University,Jiaozuo 454000,China
    2.School of Software,Henan Polytechnic University,Jiaozuo 454000,China
  • Received:2023-08-27 Online:2025-05-01 Published:2025-07-18
  • Contact: Hui WANG E-mail:szh@hpu.edu.cn;wanghui_jsj@foxmail.com

Abstract:

To address the problem of low cache hit ratio in edge nodes for privacy-preserving in the Internet of Vehicles (IoV), a deep deterministic policy gradient caching (DDPGC) method was proposed. Firstly, a taxi certified by a trusted authority acted as a second-level caching edge node to acquire hotspot data and store it in the local cache. It then broadcasted this information to the neighboring service requesting vehicles (SRV). SRVs cached the broadcasted data locally and search for service requests in the order of priority of local cache, taxi, and cloud server when such requests arise. Secondly, a neural network was deployed in taxis and SRV to maximize the caching benefit through deep reinforcement learning for decision replacement of their cached data. Finally, when SRV were located in vehicle sparsity and could not obtain request data from neighboring vehicles, a combination of k-anonymity and random response perturbation mechanisms generated anonymity sets to send requests to cloud servers in an anonymous manner to obtain services while protecting user location privacy. Simulation experimental results show that DDPGC can effectively improve the vehicle cache hit ratio, reduce the frequency of SRV interaction with the cloud server, and effectively protect user privacy security.

Key words: computer application, Internet of Vehicles, privacy protection, deep reinforcement learning, cache replacement

CLC Number: 

  • TP393

Fig. 1

System model of DDPGC"

Fig.2

Taxi side average cache hit ratio"

Fig.3

Cache hit ratio with different cache replacement policies"

Fig.4

Request latency when connecting to different SRV"

Fig.5

Relationship between cache hit ratio and level of privacy protection"

Fig.6

Number of SRV connected and privacy protection degree"

[1] Li Y, Tao X, Zhang X, et al. Break the data barriers while keeping privacy: a graph differential privacy method[J]. IEEE Internet of Things Journal, 2023, 10(5): 3840-3850.
[2] 崔杰, 陈学峰, 张静, 等. 基于公交车缓存的车联网位置隐私保护方案[J]. 通信学报, 2021, 42(7): 150-161.
Cui Jie, Chen Xue-feng, Zhang Jing, et al. Bus cache-based location privacy protection scheme in the Internet of vehicles[J]. Journal on Communications, 2021, 42(7): 150-161.
[3] Liu T, Zhang J. An adaptive traffic flow prediction model based on spatiotemporal graph neural network[J]. The Journal of Supercomputing, 2023, 79(14): 15245-15269.
[4] Zhang K, Liu Y, Zhang J, et al. TDCA: improved optimization algorithm with degree distribution and communication traffic for the deployment of software components based on autosar architecture[J]. Soft Computing, 2023, 27(12): 7999-8012.
[5] 张健, 李青扬, 李丹, 等. 基于深度强化学习的自动驾驶车辆专用道汇入引导[J]. 吉林大学学报: 工学版, 2023, 53(9): 2508-2518.
Zhang Jian, Li Qing-yang, Li Dan, et al. Merging guidance of exclusive lanes for connected and autonomous vehicles based on deep reinforcement learning[J]. Journal of Jilin University (Engineering and Technology Edition), 2023, 53(9): 2508-2518.
[6] Dai Y, Xu D, Zhang K, et al. Deep reinforcement learning and permissioned blockchain for content caching in vehicular edge computing and networks[J]. IEEE Transactions on Vehicular Technology, 2020, 69(4): 4312-4324.
[7] 宁兆龙, 张凯源, 王小洁, 等. 基于多智能体元强化学习的车联网协同服务缓存和计算卸载[J]. 通信学报, 2021, 42(6): 118-130.
Ning Zhao-long, Zhang Kai-yuan, Wang Xiao-jie, et al. Cooperative service caching and peer offloading in Internet of vehicles based on multi-agent meta-reinforcement learning[J]. Journal on Communications, 2021, 42(6): 118-130.
[8] Sabnis A, Salem T S, Neglia G, et al. GRADES: gradient descent for similarity caching[J]. IEEE/ACM Transactions on Networking, 2023, 31(1): 30-41.
[9] Zong T, Li C, Lei Y, et al. Cocktail edge caching: ride dynamic trends of content popularity with ensemble learning[C]∥IEEE INFOCOM 2021 - IEEE Conference on Computer Communications, Vancouver, Canada, 2021: 1-10.
[10] Yang J, Song Z, He P, et al. Social-aware caching strategy based on joint action deep reinforcement learning[J]. Wireless Communications and Mobile Computing, 2021, 2021: 1-15.
[11] Hu L, Qian Y, Chen M, et al. Proactive cache-based location privacy preserving for vehicle networks[J]. IEEE Wireless Communications, 2018, 25(6): 77-83.
[12] Ni S, Xie M, Qian Q. Clustering based k-anonymity algorithm for privacy preservation[J]. International Journal of Network Security, 2017, 19(6): 1062-1071.
[1] Yue HOU,Jin-song GUO,Wei LIN,Di ZHANG,Yue WU,Xin ZHANG. Multi-view video speed extraction method that can be segmented across lane demarcation lines [J]. Journal of Jilin University(Engineering and Technology Edition), 2025, 55(5): 1692-1704.
[2] Hong-wei ZHAO,Ming-zhu ZHOU,Ping-ping LIU,Qiu-zhan ZHOU. Medical image segmentation based on confident learning and collaborative training [J]. Journal of Jilin University(Engineering and Technology Edition), 2025, 55(5): 1675-1681.
[3] You-wei WANG,Ao LIU,Li-zhou FENG. New method for text sentiment classification based on knowledge distillation and comment time [J]. Journal of Jilin University(Engineering and Technology Edition), 2025, 55(5): 1664-1674.
[4] Jun WANG,Chang-fu SI,Kai-peng WANG,Qiang FU. Intrusion detection method based on ensemble learning and feature selection by PSO-GA [J]. Journal of Jilin University(Engineering and Technology Edition), 2025, 55(4): 1396-1405.
[5] Tao XU,Shuai-di KONG,Cai-hua LIU,Shi LI. Overview of heterogeneous confidential computing [J]. Journal of Jilin University(Engineering and Technology Edition), 2025, 55(3): 755-770.
[6] Qi-liang ZHU,Xue-ting YU. k⁃prototype clustering algorithm and privacy protection for sensitive data republishing under relative entropy [J]. Journal of Jilin University(Engineering and Technology Edition), 2025, 55(3): 1009-1014.
[7] Xiang-jiu CHE,Yu-ning WU,Quan-le LIU. A weighted isomorphic graph classification algorithm based on causal feature learning [J]. Journal of Jilin University(Engineering and Technology Edition), 2025, 55(2): 681-686.
[8] Xiao-dong CAI,Qing-song ZHOU,Yan-yan ZHANG,Yun XUE. Social recommendation based on global capture of dynamic, static and relational features [J]. Journal of Jilin University(Engineering and Technology Edition), 2025, 55(2): 700-708.
[9] Meng-xue ZHAO,Xiang-jiu CHE,Huan XU,Quan-le LIU. A method for generating proposals of medical image based on prior knowledge optimization [J]. Journal of Jilin University(Engineering and Technology Edition), 2025, 55(2): 722-730.
[10] Yuan-ning LIU,Zi-nan ZANG,Hao ZHANG,Zhen LIU. Deep learning-based method for ribonucleic acid secondary structure prediction [J]. Journal of Jilin University(Engineering and Technology Edition), 2025, 55(1): 297-306.
[11] Xiao-ran GUO,Tie-jun WANG,Yue YAN. Entity relationship extraction method based on local attention and local remote supervision [J]. Journal of Jilin University(Engineering and Technology Edition), 2025, 55(1): 307-315.
[12] Hao WANG,Bin ZHAO,Guo-hua LIU. Temporal and motion enhancement for video action recognition [J]. Journal of Jilin University(Engineering and Technology Edition), 2025, 55(1): 339-346.
[13] Lu Li,Jun-qi Song,Ming Zhu,He-qun Tan,Yu-fan Zhou,Chao-qi Sun,Cheng-yu Zhou. Object extraction of yellow catfish based on RGHS image enhancement and improved YOLOv5 network [J]. Journal of Jilin University(Engineering and Technology Edition), 2024, 54(9): 2638-2645.
[14] Hong-wei ZHAO,Hong WU,Ke MA,Hai LI. Image classification framework based on knowledge distillation [J]. Journal of Jilin University(Engineering and Technology Edition), 2024, 54(8): 2307-2312.
[15] Guang-he ZHU,Zhi-qiang ZHU,Yi-ping YUAN. Deep reinforcement learning optimization scheduling algorithm for continuous production line [J]. Journal of Jilin University(Engineering and Technology Edition), 2024, 54(7): 2086-2092.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
[1] Kou Shu-qing,Qiao Jian,Pi Wen-hao,Yang Shen-hua . Analysis of factors influencing knurling connected hollow
camshaft assembling process
[J]. 吉林大学学报(工学版), 2008, 38(02): 323 -0328 .
[2] YAN Hong-yu,WU Wen-fu,YIN Hui-min, HAN Feng. Influence of working parameters on loss rate of vertical roll corn harvester[J]. 吉林大学学报(工学版), 2010, 40(01): 113 -0118 .
[3] CHEN Shu-Ming, WANG Deng-Feng, MA Yi-Gong, CAO Xiao-Lin, LIU Bo, ZAN Jian-Meng. Effect of calculation precision of modal density on precision of car interior noise prediction[J]. 吉林大学学报(工学版), 2010, 40(02): 335 -0340 .
[4] Zhang Guo-xiang,,, Chen Guang-nan,Zhang Kun,Luo Geng-xing,Li Huai-xue,. AEffect of mismatch of yielding strength and residual stresses along substrate interface on interfacial crack propagation[J]. 吉林大学学报(工学版), 2006, 36(03): 294 -0297 .
[5] Liang Jin-guang,Yu Xiu-min,Gao Yue,Yu Hong-yang,Li Ya-qun1,Yu Xiao-lu . Effects of start end symbol rotating speed, fuel supply and ambient temperature
on start behavior of an electronically controlled diesel engine
[J]. 吉林大学学报(工学版), 2007, 37(05): 1023 -1027 .
[6] Su Yan,Liu Zhong-chang,Sun Wan-chen,Guo Liang,Du Bao-cheng . Development and application of measure and control system for diesel engine under start conditions[J]. 吉林大学学报(工学版), 2007, 37(01): 60 -64 .
[7] SUN Yang, SONG Rui, HE Shi-Wei. Feeder bus network design under elastic demand[J]. 吉林大学学报(工学版), 2011, 41(02): 349 -0354 .
[8] ZONG Fang, ZHANG Yi-shan, WANG Zhan-zhong, LI Zhi-yao. Parking pricing analysis in urban central business district[J]. 吉林大学学报(工学版), 2013, 43(05): 1235 -1240 .
[9] LUO Bo-wen, WAN Ming-kang, YU Hong-yi. Combining-weight estimation algorithm based on signal autocorrelation coefficient[J]. 吉林大学学报(工学版), 2013, 43(05): 1401 -1407 .
[10] HAN Qiang, JIANG Wen-long, YAO Guan-xin. Performance of red electrophosphorescent devices with mixed host[J]. 吉林大学学报(工学版), 2011, 41(03): 787 -790 .