A coordinated control method for road traffic lights based on reinforcement learning

Abstract

A road traffic light coordination and control method based on reinforcement learning, comprising: a monitoring device is provided corresponding to each intersection, and each monitoring device is connected to a remote server through a network module. The control method comprises: (1) the remote server calculates a waiting time S by receiving a video signal; (2) the remote server performs analysis to obtain a road congestion condition under each phase state a i; (3) the remote server obtains a feasible degree ci ai under the phase state a i, wherein when a flow of traffic can pass through the road, the road is clear and the feasible degree ci ai is 1; otherwise, the road is congested and the feasible degree ci ai is 0; (4) the waiting time S and the feasible degree ci ai are used to calculate an optimal driving phase state a i of the intersection; (5) adjust the traffic lights. Based on video information acquired in real time and by means of coordination and control of traffic lights of a plurality of intersections in one area, traffic efficiency is improved, the flow of traffic of the area is maximized, and the road traffic congestion condition is alleviated.

Description

technical field [0001] The invention relates to a method for controlling road traffic signal lamps, in particular to a method for coordinated control of road traffic signal lamps based on reinforcement learning. Background technique [0002] Traffic is the foundation of modern society and the lifeblood of human society and economy. People's social behavior is closely related to traffic. In a city, there are a large number of motor vehicles and non-motor vehicles, and the intersections and road sections are complicated. It is very complicated to deal with such a large-scale, dynamic, and highly uncertain distributed system for effective control. work. In the case of no new traffic roads, it is an effective way to quickly solve urban traffic problems through reasonable traffic control to improve the utilization efficiency of roads, and then improve the traffic efficiency. [0003] However, traffic congestion and congestion are becoming more and more serious now. The reasons...

AI Technical Summary

Problems solved by technology

These factors will cause some intersections to pass poorly, or even paralyzed

At present, many traffic management departments can only rely on manpower to direct on-site and directly control the changes of signal lights manually.

However, manual management of traffic lights is likely to cause omissions; at the same time, manual management of traffic lights generally only manages the signal lights of a single intersection, and it is difficult to achieve coordinated control of regional signal lights. Due to the heavy traffic ahead, the embarrassing situation of still encountering congestion

Images