Urban road network signal coordination control method based on game equilibrium theory

Abstract

The invention relates to an urban road network signal coordination control method based on a game equilibrium theory. The method comprises the following steps: collecting vehicle information in a vehicle-road coordination environment; determining the traffic state of the current intersection and the joint state of the current intersection and the adjacent intersection according to the collected vehicle information; constructing a distributed signal control game model and combining a greedy strategy so as to obtain an action strategy of an intelligent agent; updating the income matrix of the intersection by adopting a multi-agent reinforcement learning method; and based on the updated income matrix, with a distributed signal control game model, obtaining a corresponding action signal so as to correspondingly control the working state of the signal lamp. Compared with the prior art, distributed signal line cooperative control can be realized in a vehicle-road cooperative environment, the defect of long calculation time of a traditional centralized method is avoided, and each signal intersection reaches a game equilibrium state, so that the traffic efficiency of the intersection is improved, and the problem of traffic jam is prevented.

Description

technical field [0001] The invention relates to the technical field of intelligent traffic control, in particular to an urban road network signal coordination control method based on game equilibrium theory. Background technique [0002] The coordinated control of urban road network signals is one of the effective methods to alleviate traffic congestion and improve traffic efficiency. However, most of the current coordinated control methods for road network signals are based on centralized methods, using heuristic algorithms to obtain optimal control schemes. The solution efficiency is low and difficult applied in practice. [0003] In recent years, the rapid development of vehicle-road coordination technology has shown great potential in solving traffic safety, road congestion and improving driving experience. In the vehicle-road collaborative environment, the information of the vehicle and the surrounding environment can be obtained in real time, and the urban road networ...

AI Technical Summary

Problems solved by technology

Existing research on coordinated control of urban road networks faces two challenges: first, coordinated control requires the behavior of each agent to cooperate with each other, which may lead to non-convergence of optimization model results, and only approximate solutions can be obtained through heuristic algorithms, reducing coordination Stability of control; another challenge is that traditional centralized control schemes are prone to the curse of dimensionality, and the joint policy space grows rapidly as the network size increases, resulting in a significant decrease in computational efficiency

All of these will lead to low traffic efficiency at intersections and prone to traffic congestion. Therefore, designing a stable and distributed road network signal coordination control method is an urgent problem to be solved at present.

Images