Intelligent parking method based on model reinforcement learning

A technology of reinforcement learning and intelligent parking, applied in the direction of control devices, etc., can solve the problems of ineffective use of existing data and inflexible information processing.

Active Publication Date: 2021-02-12
TONGJI UNIV
View PDF5 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The purpose of the present invention is to provide a smart parking method based on model reinforcement learning in order to overcome the defects of the above-mentioned

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Intelligent parking method based on model reinforcement learning
  • Intelligent parking method based on model reinforcement learning
  • Intelligent parking method based on model reinforcement learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0101] The present invention will be described in detail below in conjunction with the accompanying drawings and specific embodiments. This embodiment is carried out on the premise of the technical solution of the present invention, and detailed implementation and specific operation process are given, but the protection scope of the present invention is not limited to the following embodiments.

[0102] Such as figure 1 As shown, an intelligent parking method based on model reinforcement learning, using Monte Carlo tree search, action classification network and state value fitting network, specifically includes the following steps:

[0103] S1. Monte Carlo tree search combines action classification network and vehicle kinematics model to obtain parking data pre-training model;

[0104] S2. The parking data training state value fitting network generated according to the parking pre-training model;

[0105] S3. The trained state value fitting network is combined with the Monte...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to an intelligent parking method based on model reinforcement learning, which uses Monte Carlo tree search, a vehicle kinematics model, an action classification network and a state value fitting network, and specifically comprises the following steps: S1, combining the Monte Carlo tree search with the action classification network and the vehicle kinematics model to obtain aparking data pre-training model; S2, training a state value fitting network according to parking data generated by the parking pre-training model; S3, combining the trained state value fitting networkwith a Monte Carlo tree search and action classification network to form an online driving strategy model; and S4, enabling the parking on-line driving strategy model to receive the parking space andthe vehicle motion information in a rolling time domain mode, generate a control instruction at each time interval, and send the control instruction to a vehicle motion control module to control thetarget vehicle to complete parking. Compared with the prior art, the method has the advantages that the final parking course angle and success rate are better, the influence of the accuracy of the vehicle model on the final parking effect is reduced, and the like.

Description

technical field [0001] The invention relates to the technical field of automatic parking, in particular to an intelligent parking method based on model reinforcement learning. Background technique [0002] Automated Parking Systems (APS) are important intelligent driver assistance systems because they have great potential to reduce accidents in cramped cities and increase the utilization of parking spaces. For all APS platforms, the smart vehicle must have a parking space that detects the location and generates its movement by on-board sensor systems, such as around view cameras (AVM) and LiDAR (LIDAR). The conventional motion planning method of APS is the path velocity decomposition method, which decomposes the parking task into a kinematics sub-problem and a dynamics sub-problem, which are solved by path planning and path tracking methods respectively, but cannot flexibly process real-time perception information, and cannot use historical parking Vehicle data to improve i...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): B60W30/06B60W50/00
CPCB60W30/06B60W50/00B60W2050/0034
Inventor 陈慧宋绍禹孙宏伟刘美岑
Owner TONGJI UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap