Anti-collision control method based on depth reinforcement learning

A technology of reinforcement learning and control methods, applied in the field of assisted driving and automatic driving, can solve problems such as weak adaptive ability, high cost, and inability to adapt to early warning requirements, and achieve the effect of improving control performance and strong adaptability

Active Publication Date: 2019-07-19
HUNAN UNIV
View PDF6 Cites 23 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Although this patent can accurately realize collision warning, the cost is too high, which is not conducive to the general promotion and use
[0005] To sum up, in the vehicle anti-collision control system, the image of the front situation is generally obtained through the camera, the feature value is extracted to identify vehicles, pedestrians, etc., and the distance and speed information are obtained, and then the danger is judg

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Anti-collision control method based on depth reinforcement learning
  • Anti-collision control method based on depth reinforcement learning
  • Anti-collision control method based on depth reinforcement learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0030] In the drawings, the same or similar reference numerals are used to denote the same or similar elements or elements having the same or similar functions. Embodiments of the present invention will be described in detail below in conjunction with the accompanying drawings.

[0031]The anti-collision control method based on deep reinforcement learning provided in this embodiment adopts a deep deterministic policy gradient method for deep reinforcement learning, and the method includes the following steps:

[0032] Step 1, extract the vehicle parameters and environment vehicle parameters. in:

[0033] The own vehicle parameters include the speed v at which the own vehicle 1 is traveling.

[0034] Taking the three-lane situation as an example, the surrounding vehicles include the vehicles driving in the same lane as the own vehicle 1 and longitudinally in front of the own vehicle 1 (hereinafter referred to as "the front vehicle 2"), and the vehicles driving in the lane whe...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an anti-collision control method based on depth reinforcement learning. A depth deterministic policy gradient method (DDPG algorithm) is adopted for depth reinforcement learning, and the anti-collision control method includes the steps that first, vehicle parameters and environmental vehicle parameters are extracted; second, a virtual environment model is constructed through the vehicle parameters and the environmental vehicle parameters; third, according to the vehicle parameters, the environmental vehicle parameters and the virtual environment model, basic parametersof the depth deterministic policy gradient method are defined; fourth, according to the basic parameters defined in the third step, a neural network in depth reinforcement learning is used for constructing an anti-collision control decision making system, and the anti-collision control decision making system comprises a strategy network and an evaluation network; and fifth, the strategy network and the evaluation network are trained, and the anti-collision control decision making system is obtained. According to the anti-collision control method based on depth reinforcement learning, the anti-collision control decision making system based on the depth neural network and the anti-collision control decision making system for constantly optimizing network control results based on a time difference reinforcement learning method are constructed, and the control performance of the anti-collision control decision making system is improved effectively.

Description

technical field [0001] The invention relates to the technical fields of assisted driving and automatic driving, and in particular to an anti-collision control method based on deep reinforcement learning. Background technique [0002] When the vehicle is running, keeping a stable safe distance from the vehicle in front can effectively prevent the occurrence of collision accidents. With the increase of the number of cars, the density of cars on the road is increasing, so the forward collision warning of vehicles is particularly important. The anti-collision control system can judge the vertical and horizontal distances, vertical and horizontal relative speeds and orientations between the vehicle 1 and the vehicle in front 2 and the vehicle in front of the side lane. When there is a potential collision risk, the vehicle can be controlled to a certain extent, which can effectively reduce the collision between the vehicle and the vehicle. The collision accident of the vehicle in...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): B60W30/08
CPCB60W30/08
Inventor 谢国涛王静雅胡满江秦晓辉王晓伟徐彪秦兆博孙宁钟志华
Owner HUNAN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products