Unlock instant, AI-driven research and patent intelligence for your innovation.

Robot path navigation method and system based on improved DDPG algorithm

A path navigation and robot technology, which is applied in the field of robot path navigation methods and systems, and can solve problems such as inaccurate navigation

Active Publication Date: 2021-09-17
SHANDONG NORMAL UNIV
View PDF5 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0007]The robot path navigation based on the existing technology has the problem that the navigation is not accurate enough

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Robot path navigation method and system based on improved DDPG algorithm
  • Robot path navigation method and system based on improved DDPG algorithm
  • Robot path navigation method and system based on improved DDPG algorithm

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0036] The present embodiment provides the robot path navigation method based on the improved DDPG algorithm;

[0037] Such as figure 1 As shown, the robot path navigation method based on the improved DDPG algorithm includes:

[0038] S101: Obtain the current state information and target position of the robot;

[0039] S102: Input the current state information and target position of the robot into the improved DDPG network after training to obtain optimal executable action data;

[0040] S103: The robot completes collision-free path navigation according to the optimal executable motion data;

[0041]Wherein, the improved DDPG network is based on the DDPG network, and the reward value calculation of the DDPG network is completed using a curiosity reward mechanism model; the curiosity reward mechanism model includes: several sequentially connected LSTM models; the sequentially connected In the LSTM model of , the input terminals of all LSTM models are connected to the output ...

Embodiment 2

[0082] The present embodiment provides the robot path navigation system based on the improved DDPG algorithm;

[0083] Robot path navigation system based on improved DDPG algorithm, including:

[0084] An acquisition module configured to: acquire the current state information and target position of the robot;

[0085] The output module is configured to: input the current state information and target position of the robot into the improved DDPG network after training to obtain the optimal executable action data;

[0086] A navigation module, which is configured to: the robot completes collision-free path navigation according to the optimal executable motion data;

[0087] Wherein, the improved DDPG network is based on the DDPG network, and the reward value calculation of the DDPG network is completed using a curiosity reward mechanism model; the curiosity reward mechanism model includes: several sequentially connected LSTM models; the sequentially connected In the LSTM model ...

Embodiment 3

[0092] This embodiment also provides an electronic device, including: one or more processors, one or more memories, and one or more computer programs; wherein, the processor is connected to the memory, and the one or more computer programs are programmed Stored in the memory, when the electronic device is running, the processor executes one or more computer programs stored in the memory, so that the electronic device executes the method described in Embodiment 1 above.

[0093] It should be understood that in this embodiment, the processor can be a central processing unit CPU, and the processor can also be other general-purpose processors, digital signal processors DSP, application specific integrated circuits ASIC, off-the-shelf programmable gate array FPGA or other programmable logic devices , discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor, or the processor may be any conventional processor, o...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a robot path navigation method and system based on an improved DDPG algorithm. The method comprises the following steps: acquiring current state information and a target position of a robot; inputting the current state information and the target position of the robot into the trained improved DDPG network to obtain optimal executable action data, and completing collision-free path navigation; the improved DDPG network completes the calculation of the reward value of the DDPG network by using a curiosity reward mechanism model; the curiosity reward mechanism model comprises a plurality of LSTM models which are sequentially connected in series; in the LSTM models connected in series in sequence, the input ends of all the LSTM models are connected with the output end of the current Actor network, the output end of the last LSTM model is connected with the input end of the CNN model, and the output end of the CNN model is connected with the input end of the current Actor network. The curiosity-based robot path navigation can make the robot more intelligent.

Description

technical field [0001] The invention relates to the technical field of path planning, in particular to a robot path navigation method and system based on an improved DDPG algorithm. Background technique [0002] The statements in this section merely mention the background technology related to the present invention and do not necessarily constitute the prior art. [0003] With the development of artificial intelligence technology, robots have gradually entered our daily life from the original industrial production field. Especially in recent years, there has been a vigorous development momentum in the service industry. Human society's demand for mobile robots is also becoming stronger and stronger. The path planning of the robot is a key problem to be solved in the field of robotics. The path planning of mobile robots is a complex problem, which requires autonomous mobile robots to find an obstacle-free path from the initial position to the target position according to th...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06Q10/04G06N3/04G06N3/08G01C21/20
CPCG06Q10/047G06N3/08G01C21/20G06N3/044G06N3/045
Inventor 吕蕾赵盼盼周青林
Owner SHANDONG NORMAL UNIV