Unlock instant, AI-driven research and patent intelligence for your innovation.

An automatic parking method based on deep reinforcement learning

A technology of automatic parking and reinforcement learning, applied in the direction of control devices, etc., can solve the problems of inability to achieve real-time interaction of the environment, and achieve the effects of reducing stability, ensuring safety, and long training time.

Active Publication Date: 2021-05-11
中创子云(宁波)成果产业化服务有限公司
View PDF3 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] Aiming at the above-mentioned deficiencies in the prior art, the present invention provides an automatic parking method based on deep reinforcement learning, which solves the problem that the current automatic parking system cannot achieve real-time interaction with the environment, and cannot realize parking at any place and at any time. Angle start parking problem

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • An automatic parking method based on deep reinforcement learning
  • An automatic parking method based on deep reinforcement learning
  • An automatic parking method based on deep reinforcement learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0067] The basic idea of ​​the present invention is to use the powerful perception ability of deep learning to perceive the current state of the car, that is, to perceive the relative positional relationship between the car and the parking space, then input the state of the car into the network model, and use the decision-making ability of reinforcement learning to obtain the The actions that need to be performed in the state, input the actions that need to be performed into the environment model to obtain the next state and reward function value, and then use a reward mechanism to evaluate the quality of the action just performed, and guide the car to drive in the direction of the parking point , and finally repeat the previous operations in the next state until an optimal parking route is obtained.

[0068] In order to perceive the current state of the car, two simulation environments with different levels of complexity are designed: an unrestricted simulation environment and...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides an automatic parking method based on deep reinforcement learning. The basic idea of ​​the invention is to use the powerful perception ability of deep learning to perceive the current state of the car, that is, to perceive the relative positional relationship between the car and the parking space, and then place the car Input the state of the state into the deep deterministic policy gradient model, use the decision-making ability of reinforcement learning to get the action that needs to be executed in this state, input the action that needs to be executed into the environment model to get the next state and reward function value, and then go through a reward mechanism Evaluate the quality of the action just performed, and guide the car towards the direction of the parking point, and repeat the previous operation in the next state until the model converges, that is, the car accurately parks in the parking space. Through the above design, the present invention solves the problem that the current automatic parking system cannot achieve real-time interaction with the environment, and cannot realize parking at any place and any angle.

Description

technical field [0001] The invention belongs to the technical field of automobiles, in particular to an automatic parking method based on deep reinforcement learning. Background technique [0002] With the continuous development of the automobile industry and the continuous increase of car ownership, the problem of difficult parking in cities has become more and more serious, and automatic parking technology has begun to develop. Automatic parking can not only free your hands and facilitate people's lives, but also reduce the parking pressure in the city and reduce the safety hazards in the parking process, which plays a very important role in urban construction. [0003] Now the main research of automatic parking system is to plan the parking path according to the parking space detected by the sensor, and then guide the car to follow the planned parking route according to the path tracking module. However, the parking process is a dynamic process, which requires continuous...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): B60W30/06B60W50/00
CPCB60W30/06B60W50/0098B60W2050/0003B60W2050/0043
Inventor 龙强陶顺波
Owner 中创子云(宁波)成果产业化服务有限公司