Journal of Jilin University Science Edition ›› 2023, Vol. 61 ›› Issue (6): 1432-1440.

Previous Articles     Next Articles

Algorithm for Target Coverage Problem Based on Deep Q Learning in Wireless Sensor Networks

GAO Sihua1,2, GU Han1, HE Huaiqing1, ZHOU Gang3   

  1. 1. College of Computer Science and Technology, Civil Aviation University of China, Tianjin 300300, China;
     2. College of Computer Science and Technology, Jilin University, Changchun 130012, China;
    3. Department of Science and Technology Management, TravelSky Technology Limited, Beijing 101300, China
  • Received:2022-12-20 Online:2023-11-26 Published:2023-11-26

Abstract: Aiming at the uncertain mechanism  of node activation strategies and redundancy of feasible solution sets in the process of solving target coverage problem in wireless sensor networks, we proposed a deep Q learning based target coverage algorithm to learn the scheduling strategies of nodes in wireless sensor networks. Firstly, the algorithm abstracted the construction of feasible solution sets into  Markov decision process, and intelligently selected activated sensor nodes as discrete actions according to the network environment. Secondly, a reward function  evaluated the performance of the intelligent agent in selecting actions based on the 
 coverage capacity and its residual energy of the active node. The simulation  experiment result shows that the algorithm is effective in different network environments, and the network lifecycle is superior to the  three  greedy algorithms, the maximum lifetime  coverage algorithm and the adaptive learning automaton algorithm.

Key words: target coverage problem, deep Q learning, wireless sensor networks, reinforcement learning

CLC Number: 

  • TP391