A Reinforcement Learning-Based Method for Economical Passage at Intersections Controlled by Signal Lights of Connected Vehicles

A technology of reinforcement learning and signal lights, applied in vehicle wireless communication services, services based on location information, services based on specific environments, etc., can solve the problems of convenient application and research of ecological driving strategies that are not yet mature, and achieve the effect of good generalization ability

Active Publication Date: 2021-12-10
SOUTHEAST UNIV
View PDF5 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The Actor-Critic architecture can directly output action information and has powerful optimization capabilities. The research on the convenient application of ecological driving strategies is not yet mature

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A Reinforcement Learning-Based Method for Economical Passage at Intersections Controlled by Signal Lights of Connected Vehicles
  • A Reinforcement Learning-Based Method for Economical Passage at Intersections Controlled by Signal Lights of Connected Vehicles
  • A Reinforcement Learning-Based Method for Economical Passage at Intersections Controlled by Signal Lights of Connected Vehicles

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0052] The specific embodiments of the present invention will be described below in conjunction with the accompanying drawings.

[0053] In this embodiment, a network-connected vehicle signal light-controlled intersection economical passage method based on reinforcement learning can be referred to figure 1 , the computing system based on it includes an information acquisition module, an environment model module, and a vehicle speed optimization module. The information acquisition module includes obtaining roadside unit information and vehicle operating status information based on wireless short-wave communication or 5G\LTE protocol communication OBU / RSU; environment model The module includes building a vehicle model, roadside signal lights and the traffic environment model of the vehicle in front; the vehicle speed optimization module includes using deep reinforcement learning algorithms to construct a pure electric vehicle signal light control intersection traffic strategy, an...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The present invention relates to a network-connected vehicle signal light-controlled intersection economical traffic method based on reinforcement learning, which comprises the following steps: obtaining vehicle and roadside environmental status information; building an ecological driving model for intersection traffic: including building a longitudinal dynamics model of a vehicle and building a road The traffic environment model of the side signal light state; using the deep deterministic policy gradient algorithm to construct the ecological driving strategy for the intersection of pure electric networked vehicles, solve the multi-objective optimization problem including the minimum energy consumption of the vehicle battery and the shortest transit time, and obtain the optimal traffic speed spectrum , so as to obtain the optimal energy consumption level through the intersection. The invention applies the deep reinforcement learning algorithm to the actual vehicle intersection traffic control, and has good generalization performance and optimization effect for the dynamic change scene of the remaining time of the signal light.

Description

technical field [0001] The invention relates to the technical field of smart traffic and intelligent networked vehicle control, in particular to a method for economical crossing traffic controlled by signal lights of networked vehicles based on reinforcement learning. Background technique [0002] The rapid development of urbanization has brought great challenges to the road traffic environment, and the increasingly crowded traffic intersections with signal lights have generated a lot of unnecessary energy consumption. The entry and exit of economical intersections has always been the main research focus of traffic decision-making in urban traffic intersections. From the perspective of vehicles, the emergence of intelligent networked vehicles provides a new solution to improve traffic efficiency and alleviate the phenomenon of parking and waiting at urban light-controlled intersections. In addition to being driven by new energy, smart electric vehicles are based on the low-...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G08G1/01G08G1/0967G07C5/08H04W4/02H04W4/44G06F30/20
CPCG08G1/0112G08G1/0116G08G1/0125G08G1/0137G08G1/096783G07C5/0808G07C5/0841H04W4/025H04W4/027H04W4/44G06F30/20Y02D30/70
Inventor 殷国栋丁昊楠董昊轩
Owner SOUTHEAST UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products