Man-machine cooperative dynamic obstacle avoidance method and system based on deep reinforcement learning

A technology of dynamic obstacle avoidance and enhanced learning, applied in the fields of motor vehicles, control/regulation systems, non-electric variable control, etc. High stability effect

Active Publication Date: 2019-07-05
NAT UNIV OF DEFENSE TECH
View PDF5 Cites 24 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] Aiming at the problems that the intelligent vehicle dynamic obstacle avoidance method in the prior art is difficult to adapt to the complex and different scenes on the real road, the purpose of the present invention is to provide a intelligent vehicle dynamic obstacle avoidance method based on the deep reinforcement learning method under the human-computer cooperation mechanism And the system, effectively avoiding the shortco

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Man-machine cooperative dynamic obstacle avoidance method and system based on deep reinforcement learning
  • Man-machine cooperative dynamic obstacle avoidance method and system based on deep reinforcement learning
  • Man-machine cooperative dynamic obstacle avoidance method and system based on deep reinforcement learning

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0060] Such as Figure 1-28 The shown method for dynamic obstacle avoidance of smart cars based on deep reinforcement learning method includes the following steps:

[0061] S1. Obtain the simulated perception image of the smart car at time t I t ;

[0062] S2, will simulate the perception image I t Input the neural network model, and the neural network model outputs the state characteristics of the smart car at time t s t And the probability of performing each action;

[0063] S3. Select the action a of the smart car at time t according to the probability distribution corresponding to each action t And output, among which, according to the ε-greedy strategy, the execution action a of the smart car at time t is determined from each action t ,specific:

[0064] Select the action of the smart car in the ratio of (1-ε) according to the action of the neural network model to interact with the environment, and randomly select the action of the smart car in the ratio of ε, at this time, the ac...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides an intelligent vehicle dynamic obstacle avoidance method and an intelligent vehicle dynamic obstacle avoidance system based on deep reinforcement learning. The intelligent vehicle dynamic obstacle avoidance method comprises the steps of: S1, acquiring an image of an intelligent vehicle at a moment t; S2, inputting the image into a neural network model, and outputting a probability corresponding to execution of each action by the intelligent vehicle; S3, selecting an executed action of the intelligent vehicle at the moment t; S4, recording simulation data of the intelligent vehicle at the moment t; S5, setting t to be equal to t+1, repeating the S1-S4 until the simulation ends, and archiving the simulation data; S6, and transferring simulation data from a positive sample experience pool or a negative sample experience pool for training the neural network model while circulating the S1-S6 continuously until a dynamic obstacle avoidance strategy of the intelligent vehicle can perform dynamic obstacle avoidance completely in the simulation process. The trained dynamic obstacle avoidance strategy is applied to the dynamic obstacle avoidance under a man-machine cooperation mechanism, so as to complement the advantages of a human driver and an intelligent machine on behavior decisions of emergency obstacle avoidance of the intelligent vehicle, thereby achievinga unified and superior decision-making method. The man-machine cooperative dynamic obstacle avoidance method is applied to the field of intelligent decision making of intelligent vehicles.

Description

technical field [0001] The invention relates to the field of environment perception of intelligent vehicles, in particular to a dynamic obstacle avoidance method for intelligent vehicles based on a deep reinforcement learning method under a human-computer cooperation mechanism. Background technique [0002] In research in the field of autonomous driving, safety is the primary consideration, and research in all aspects is meaningful only when safety requirements are met. In order to achieve safe autonomous driving, smart cars sense the surrounding environment through sensors and then make decisions and plans, and then control the vehicle to reach the desired destination without traffic accidents. In recent years, in order to improve the safety of smart cars, some safety systems have been proposed, such as collision avoidance systems, pedestrian detection systems and forward obstacle warning systems. [0003] In a complex traffic system, the most important and key point to re...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G05D1/02
CPCG05D1/0214G05D2201/0212
Inventor 徐昕姚亮程榜尹昕
Owner NAT UNIV OF DEFENSE TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products