Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Traffic signal control method and system based on random strategy gradient, and electronic equipment

A traffic signal, random strategy technology, applied in the field of intelligent transportation, can solve problems such as inability to process, large state space, state space dimension explosion, etc.

Active Publication Date: 2021-04-06
DUOLUN TECH CO LTD
View PDF9 Cites 8 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] In order to overcome the problem of using traditional reinforcement learning for traffic signal control in the prior art, it can handle limited state-action pairs, but cannot handle a huge state space, and a "dimension explosion" will occur due to the state space being too large, resulting in policy learning. In order to solve the problems of low efficiency and low accuracy, the present invention provides a traffic signal control method, system and electronic equipment based on stochastic policy gradient

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Traffic signal control method and system based on random strategy gradient, and electronic equipment
  • Traffic signal control method and system based on random strategy gradient, and electronic equipment
  • Traffic signal control method and system based on random strategy gradient, and electronic equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0086] image 3 A flowchart showing a traffic signal control method based on a stochastic policy gradient according to an embodiment of the present invention, as image 3 As shown, the method may include the following steps:

[0087] Step S100: Obtain static road network data of at least one control signalized intersection.

[0088] In the embodiment of the present invention, the static road network data includes road grade, number of lanes, lane width, lane function division, road section length, road sign marking, intersection type, adjacent intersection information, signal equipment number, phase information and Part or all of the phase sequence information.

[0089] Step S200: Visually draw traffic simulation road network according to static road network data.

[0090] In the embodiment of the present invention, microscopic traffic simulation software, such as SUMO, can be used to draw the traffic simulation road network.

[0091] In an embodiment of the present invent...

Embodiment 2

[0149] Figure 4 It shows a functional block diagram of a traffic signal control system based on a stochastic policy gradient according to an embodiment of the present invention, and the device can be used to realize the traffic signal control based on a stochastic policy gradient described in Embodiment 1 or any optional implementation thereof method. Such as Figure 4 As shown, the system includes: a first data acquisition module 10 , a simulation drawing module 20 , a second data acquisition module 30 , a simulation verification module 40 , an action evaluation module 50 , an action sampling module 60 and a signal control module 70 . in,

[0150] The first data acquisition module 10 is used to acquire static road network data of at least one control signal intersection.

[0151] The simulation drawing module 20 is used for visually drawing traffic simulation road network according to static road network data.

[0152] The second data acquisition module 30 is used to acq...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a traffic signal control method and system based on a random strategy gradient, and electronic equipment. The method comprises steps of obtaining the static road network data of at least one control signal intersection; visually drawing a traffic simulation road network according to the static road network data; acquiring real-time traffic operation state data of at least one control signalized intersection; performing parameter check on simulation parameters in the traffic simulation road network according to the traffic operation state data to obtain an optimized traffic simulation road network; inputting a traffic state obtained by observing the optimized traffic simulation road network into a value network to obtain an evaluation value of each signal control scheme in the traffic state; inputting the traffic state into a strategy network to obtain a probability value of each signal control scheme; and updating parameters of the strategy network through a random strategy gradient based on the evaluation value of each signal control scheme in the traffic state and one signal control scheme. According to the method provided by the invention, a problem of dimension explosion of signal control can be solved.

Description

technical field [0001] The invention relates to the technical field of intelligent transportation, and specifically designs a traffic signal control method, system and electronic equipment based on stochastic strategy gradients. Background technique [0002] In order to meet the rapid growth of urban traffic demand, it is not only necessary to build new road infrastructure to improve the overall traffic capacity of the city, but also to improve the existing traffic infrastructure in the city, and to improve the traffic efficiency of existing roads through intelligent traffic management and control technology. As a key node of urban road network, intersection is also one of the research hotspots of urban intelligent traffic control. Urban intelligent traffic control regards the intersection as a real-time controllable system, and conducts continuous real-time monitoring, diagnosis, modeling, and control of the intersection. However, the traditional intersection signal contro...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G08G1/01G08G1/08G06F30/18G06F30/20G06N3/04G06N3/08
CPCG08G1/0125G08G1/0137G08G1/08G06F30/18G06F30/20G06N3/088G06N3/045Y02T10/40
Inventor 郑培余陶刚陈波李志斌陈冰杨光
Owner DUOLUN TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com