A Hybrid Routing Algorithm for V2V Communication in VANETs Based on Blocked Q-Learning

作者：Bi, Xiang^*; Huang, Huang; Zhang, Benhong; Wei, Xing

来源：IEICE - Transactions on Communications, 2023, E106B(1): 1-17.

DOI：10.1587/transcom.2021EBP3210

• V2V
• clustering
• heuristic algorithm
• improved Q-learning
• VANETs

It is of great significance to design a stable and reliable routing protocol for Vehicular Ad Hoc Networks (VANETs) that adopt Ve-hicle to Vehicle (V2V) communications in the face of frequent network topology changes. In this paper, we propose a hybrid routing algorithm, RCRIQ, based on improved Q-learning. For an established cluster struc-ture, the cluster head is used to select the gateway vehicle according to the gateway utility function to expand the communication range of the cluster further. During the link construction stage, an improved Q-learning algo-rithm is adopted. The corresponding neighbor vehicle is chosen according to the maximum Q value in the neighbor list. The heuristic algorithm se-lects the next-hop by the maximum heuristic function value when selecting the next-hop neighbor node. The above two strategies are comprehensively evaluated to determine the next hop. This way ensures the optimal selection of the next hop in terms of reachability and other communication param-eters. Simulation experiments show that the algorithm proposed in this article has better performance in terms of routing stability, throughput, and communication delay in the urban traffic scene.