Urban traffic jam scheduling method based on reinforcement learning

A technology of reinforcement learning and urban transportation, applied in the field of intelligent transportation, can solve the problems of difficult to deal with vehicle flow scheduling and low vehicle traffic efficiency, and achieve the effect of solving the problem of incomplete strategy input, alleviating traffic congestion and improving traffic efficiency.

Active Publication Date: 2022-05-27
CHONGQING CHANGAN AUTOMOBILE CO LTD
View PDF9 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] The existing traffic light control methods are mainly divided into two categories. One is the traditional rule-based signal light control algorithm, such as fixed duration, traffic flow, lane occupancy ratio and other algorithms. Such methods have a one-sided cognition of the scene. It is difficult to deal with vehicle flow scheduling in complex scenarios, and the efficiency of vehicle traffic is low

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Urban traffic jam scheduling method based on reinforcement learning
  • Urban traffic jam scheduling method based on reinforcement learning
  • Urban traffic jam scheduling method based on reinforcement learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0024] The present invention is further described in detail below in conjunction with the accompanying drawings.

[0025] as Figure 1 and Figure 2 As shown in the present embodiment, the urban traffic congestion scheduling method based on reinforcement learning, comprising the following steps:

[0026] (1) Real-time data of vehicle number information, vehicle queuing information and traffic light status of urban road intersections are obtained through image sensors and inductive sensors;

[0027] (2) Using machine learning algorithms, based on the real-time data of vehicle number information, vehicle queuing information and traffic light status, combined with the intersection prior knowledge of road section restrictions and lane information obtained from image information and reserve structured data, the intersection road condition status data is jointly formed as the scheduling model training data;

[0028](3) Using reinforcement learning algorithm, at a given moment, the dispatc...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an urban traffic jam scheduling method based on reinforcement learning. The method comprises the following steps: acquiring real-time data of vehicle quantity information, vehicle queuing information and traffic light states of an urban road intersection through an image sensor and an inductive sensor; using a machine learning algorithm to form intersection road condition state data as scheduling model training data according to real-time data of vehicle number information, vehicle queuing information and traffic light states and in combination with intersection prior knowledge of road section limitation and lane information obtained from image information and reserve structured data; the scheduling model calculates a reward signal according to the passing effect of each lane of the intersection fed back by the environment and a reward function, so as to train the scheduling model; using a reinforcement learning algorithm to train a scheduling model based on the intersection road condition state data and the intersection traffic safety criterion; and taking intersection road condition state data as input, and outputting a traffic light state instruction and a corresponding traffic light control signal through the trained scheduling model.

Description

Technical field [0001] The present invention relates to the field of intelligent transportation, specifically to an urban traffic jam scheduling method based on reinforcement learning. Background [0002] With the continuous improvement of the people's economic level and the advancement of the urbanization process, the automobile as the most important means of transportation has entered thousands of households, and the problem of urban traffic congestion has become more and more serious. On the one hand, traffic jams will reduce social productivity, cause a lot of economic losses, and at the same time consume fuel resources and lead to serious carbon dioxide emission problems. Therefore, improving the efficiency of urban traffic and optimizing traffic dispatch methods occupy an important position in the field of modern transportation, of which traffic light intersection traffic is the most common bottleneck of traffic efficiency in urban road sections. [0003] The existing traff...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G08G1/01G08G1/048G08G1/08G08G1/095G06F30/27
CPCG08G1/0104G08G1/048G08G1/08G08G1/095G06F30/27G06F2119/02Y02T10/40
Inventor 肖友
Owner CHONGQING CHANGAN AUTOMOBILE CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products