Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Driving collision avoidance optimization method based on deep reinforcement learning in car-following state

A technology of reinforcement learning and optimization methods, applied in the field of driving collision avoidance optimization based on deep reinforcement learning, can solve the problem of not many collision avoidance optimization methods, and achieve the effect of objective and accurate score evaluation

Pending Publication Date: 2022-01-07
CHANGAN UNIV
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Therefore, there are relatively many dangerous situations in the car-following process, but there are not many researches on the optimization method of collision avoidance in the state of driverless car-following. It is very meaningful to realize

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Driving collision avoidance optimization method based on deep reinforcement learning in car-following state
  • Driving collision avoidance optimization method based on deep reinforcement learning in car-following state
  • Driving collision avoidance optimization method based on deep reinforcement learning in car-following state

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0048] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.

[0049] A driving collision avoidance optimization method based on deep reinforcement learning in the car-following state. Based on the vehicle trajectory data of the Next Generation Simulation (NGSIM) project, the car-following data of the selected HOV lane is divided into training data and verification data. By constructing a simulation car-following scene, the reinforcement learning agent interacts with the environment through a series of states, actions and rewar...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to the technical field of automatic driving, in particular to a driving collision avoidance optimization method based on deep reinforcement learning in a car-following state. According to the method, a model is constructed by using deep reinforcement learning, automatic driving is evaluated by setting a set of independent evaluation index system instead of carrying out evaluation by comparing the difference between the model and a human driver, and the driving risk avoiding behavior can be learned more intelligently. A driving collision avoidance strategy is provided, NGSIM empirical data can be trained, driving simulation data and the like can also be trained, and the obtained result has universality. Although the driving collision avoidance optimization method is a driving collision avoidance strategy in a car-following scene, the change of model training in a new scene is not large, and high feasibility is still kept. The driving collision avoidance optimization method adopts a relatively complex reward function, so that score evaluation is more objective and accurate.

Description

technical field [0001] The invention relates to the technical field of automatic driving, in particular to a driving collision avoidance optimization method based on deep reinforcement learning in a car-following state. Background technique [0002] In recent years, with the help of the development of current artificial intelligence technology, intelligent control systems can not only make decisions according to the current environment, but also continuously learn and adapt to the environment. Machine learning is one of the key technologies of artificial intelligence. On the basis of historical data and the continuous learning and feedback properties of current intelligent control systems, autonomous decision-making strategies based on reinforcement learning (RL) perform quite well. [0003] With the development of the automobile industry, driverless cars have gradually entered the stage of history. The most important step to achieve unmanned driving is the research and de...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F30/27G06N3/04G06N3/08
CPCG06F30/27G06N3/08G06N3/045
Inventor 王驰恒康凯朱彤魏田正
Owner CHANGAN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products