Unlock instant, AI-driven research and patent intelligence for your innovation.

Anti-locking brake control method and system based on reinforcement learning

A technology of reinforcement learning and brake control, applied in control devices, brakes, etc., can solve the problems of limited, too simple reward function definition, and no breakthrough progress in algorithm development, achieve excellent performance, and solve the effect of unreasonable definition.

Active Publication Date: 2020-02-28
的卢技术有限公司
View PDF18 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The basic idea of ​​reinforcement learning is: the agent makes an action in a specific environment, the environment gives feedback rewards according to the action, the agent adjusts the action according to the reward, and expects to obtain a higher reward. From this idea, it can be seen that the reward It is very important to the learning of the agent, and in the algorithm, the reward is realized by the defined reward function, but the current development level of deep reinforcement learning technology shows that it is suitable for the task of dealing with simple scenes. On the one hand, the development of the algorithm has no breakthrough Progress, on the other hand, the definition of the reward function is too simple, the learning content of the agent is very limited, and the complex definition of the reward function will make it difficult for the agent to distinguish the reward difference in different situations, so how to define the function is very important

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Anti-locking brake control method and system based on reinforcement learning
  • Anti-locking brake control method and system based on reinforcement learning
  • Anti-locking brake control method and system based on reinforcement learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0037] Reference Figure 1~3 In this embodiment, it is proposed to apply the reinforcement learning algorithm to the anti-lock brake control. Because the reinforcement learning algorithm is more suitable for dealing with serialization problems, the anti-lock brake operation of the car during emergency braking meets the reinforcement learning One feature, so the present invention has strong practical operability, and can achieve excellent anti-lock brake control in conjunction with the definition of the reward function in the present invention.

[0038] Specifically, an anti-lock brake control method based on reinforcement learning includes the following steps:

[0039] S1: Extract key parameters, and extract the wheel speed V by analyzing and summarizing the operation principle of the traditional anti-lock braking algorithm 1 And body speed V 2 The difference ratio parameter and the single braking time length parameter T 1 .

[0040] Among them, considering that when braking, the whe...

Embodiment 2

[0074] See Figure 1~5 Schematically, this embodiment provides an anti-lock brake control system based on reinforcement learning, including:

[0075] Extraction module 100 for extracting wheel speed V 1 And body speed V 2 The difference ratio parameter and the single braking time length parameter T 1 These two key parameters and quantify the two key parameters,

[0076] Among them, the extraction module 100 specifically includes:

[0077] The analysis unit is used to analyze and summarize the control strategy of the traditional anti-lock braking algorithm;

[0078] The extraction unit is used to extract two key parameters;

[0079] The quantization unit is used to quantize the two key parameters.

[0080] The limiting module 200 limits its range according to the two quantified key parameters, and obtains the difference ratio parameter and the single braking time length parameter T when the braking distance is the shortest. 1 The range of values;

[0081] The definition module 300 is used...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses an anti-locking brake control method and system based on reinforcement learning. The method comprises the following steps of extracting key parameters; quantizing the extractedkey parameters, and defining a range of the parameters; establishing a reinforcement learning module including a reward function; defining a wheel speed change range reward function value and a braketime change range reward function value in the reward function, multiplying the wheel speed change range reward function value and the brake time change range reward function value and outputting a result; inputting the output result to the reinforcement learning module for training; and using the trained reinforcement learning module for controlling a vehicle for preventing brake locking. The defect of unreasonably defining the reward function in existing reinforcement learning is overcome, the reinforcement learning algorithm with the new defined reward function is applied to the anti-locking brake control system, and the performance more excellent than that of a traditional algorithm is achieved.

Description

Technical field [0001] The invention relates to the technical field of automobile automatic driving, in particular to an anti-lock braking control method and system based on reinforcement learning. Background technique [0002] In modern automobile products, the anti-lock brake system can ensure that the car prevents the wheels from locking during emergency braking, thereby stabilizing the body and shortening the braking distance. It is the standard configuration of the car. With the development of artificial intelligence, it has become possible to use artificial intelligence technology to achieve anti-lock brakes, which theoretically can achieve better performance than traditional algorithms. [0003] As an important direction of artificial intelligence, reinforcement learning is more suitable for dealing with serialization problems. The anti-lock braking operation of a car during emergency braking meets this feature of reinforcement learning, so it is feasible to use reinforcemen...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): B60T8/172B60T8/176B60W50/00
CPCB60T8/172B60T8/176B60W50/00B60W2050/0019
Inventor 董舒
Owner 的卢技术有限公司