Traffic signal control method and system based on random strategy gradient, and electronic equipment
What is Al technical title?
Al technical title is built by PatSnap Al team. It summarizes the technical point description of the patent document.
A traffic signal, random strategy technology, applied in the field of intelligent transportation, can solve problems such as inability to process, large state space, state space dimension explosion, etc.
Active Publication Date: 2021-04-06
DUOLUN TECH CO LTD
View PDF9 Cites 8 Cited by
Summary
Abstract
Description
Claims
Application Information
AI Technical Summary
This helps you quickly interpret patents by identifying the three key elements:
Problems solved by technology
Method used
Benefits of technology
Problems solved by technology
[0005] In order to overcome the problem of using traditional reinforcement learning for traffic signal control in the prior art, it can handle limited state-action pairs, but cannot handle a huge state space, and a "dimension explosion" will occur due to the state space being too large, resulting in policy learning. In order to solve the problems of low efficiency and low accuracy, the present invention provides a traffic signal control method, system and electronic equipment based on stochastic policy gradient
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more
Image
Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
Click on the blue label to locate the original text in one second.
Reading with bidirectional positioning of images and text.
Smart Image
Examples
Experimental program
Comparison scheme
Effect test
Embodiment 1
[0086] image 3 A flowchart showing a traffic signal control method based on a stochastic policy gradient according to an embodiment of the present invention, as image 3 As shown, the method may include the following steps:
[0087] Step S100: Obtain static road network data of at least one control signalized intersection.
[0088] In the embodiment of the present invention, the static road network data includes road grade, number of lanes, lane width, lane function division, road section length, road sign marking, intersection type, adjacent intersection information, signal equipment number, phase information and Part or all of the phase sequence information.
[0089] Step S200: Visually draw traffic simulation road network according to static road network data.
[0090] In the embodiment of the present invention, microscopic traffic simulation software, such as SUMO, can be used to draw the traffic simulation road network.
[0091] In an embodiment of the present invent...
Embodiment 2
[0149] Figure 4 It shows a functional block diagram of a traffic signal control system based on a stochastic policy gradient according to an embodiment of the present invention, and the device can be used to realize the traffic signal control based on a stochastic policy gradient described in Embodiment 1 or any optional implementation thereof method. Such as Figure 4 As shown, the system includes: a first data acquisition module 10 , a simulation drawing module 20 , a second data acquisition module 30 , a simulation verification module 40 , an action evaluation module 50 , an action sampling module 60 and a signal control module 70 . in,
[0150] The first data acquisition module 10 is used to acquire static road network data of at least one control signal intersection.
[0151] The simulation drawing module 20 is used for visually drawing traffic simulation road network according to static road network data.
[0152] The second data acquisition module 30 is used to acq...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more
PUM
Login to view more
Abstract
The invention discloses a traffic signal control method and system based on a random strategy gradient, and electronic equipment. The method comprises steps of obtaining the static road network data of at least one control signal intersection; visually drawing a traffic simulation road network according to the static road network data; acquiring real-time traffic operation state data of at least one control signalized intersection; performing parameter check on simulation parameters in the traffic simulation road network according to the traffic operation state data to obtain an optimized traffic simulation road network; inputting a traffic state obtained by observing the optimized traffic simulation road network into a value network to obtain an evaluation value of each signal control scheme in the traffic state; inputting the traffic state into a strategy network to obtain a probability value of each signal control scheme; and updating parameters of the strategy network through a random strategy gradient based on the evaluation value of each signal control scheme in the traffic state and one signal control scheme. According to the method provided by the invention, a problem of dimension explosion of signal control can be solved.
Description
technical field [0001] The invention relates to the technical field of intelligent transportation, and specifically designs a traffic signal control method, system and electronic equipment based on stochastic strategy gradients. Background technique [0002] In order to meet the rapid growth of urban traffic demand, it is not only necessary to build new road infrastructure to improve the overall traffic capacity of the city, but also to improve the existing traffic infrastructure in the city, and to improve the traffic efficiency of existing roads through intelligent traffic management and control technology. As a key node of urban road network, intersection is also one of the research hotspots of urban intelligent traffic control. Urban intelligent traffic control regards the intersection as a real-time controllable system, and conducts continuous real-time monitoring, diagnosis, modeling, and control of the intersection. However, the traditional intersection signal contro...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more
Application Information
Patent Timeline
Application Date:The date an application was filed.
Publication Date:The date a patent or application was officially published.
First Publication Date:The earliest publication date of a patent with the same application number.
Issue Date:Publication date of the patent grant document.
PCT Entry Date:The Entry date of PCT National Phase.
Estimated Expiry Date:The statutory expiry date of a patent right according to the Patent Law, and it is the longest term of protection that the patent right can achieve without the termination of the patent right due to other reasons(Term extension factor has been taken into account ).
Invalid Date:Actual expiry date is based on effective date or publication date of legal transaction data of invalid patent.
Login to view more 
Login to view more