Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Robot autonomous control method based on graph neural network reinforcement learning

A neural network and reinforcement learning technology, applied in the field of robot autonomous control based on graph neural network reinforcement learning

Active Publication Date: 2021-02-02
HANGZHOU DIANZI UNIV
View PDF5 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This method uses a reinforcement learning method, combined with the feature extraction of the relationship between elements native to the graph neural network, to solve the problem of robot autonomous control

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Robot autonomous control method based on graph neural network reinforcement learning
  • Robot autonomous control method based on graph neural network reinforcement learning
  • Robot autonomous control method based on graph neural network reinforcement learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0052] The present invention will be further described in detail below in conjunction with the accompanying drawings.

[0053] Such as figure 1 As shown, the present invention provides a robot reinforcement learning method based on a graph neural network.

[0054] Step (1) establishes the force transmission circuit diagram according to the physical structure of the robot, and establishes a structural basis for the implementation of the subsequent diagram network establishment steps, as follows:

[0055] 1-1. In order to meet the experimental requirements, we use the Ant robot provided by OpenAI to conduct simulation experiments in the mujoco simulation environment. The Mujoco simulation environment is a simulation software that simulates and simulates the parameters of the physical world environment, and simulates the acceleration of gravity in the real physical world, the energy during the collision process, and the moment of inertia during the rotation process. The Ant rob...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a robot autonomous control method based on graph neural network reinforcement learning. The robot autonomous control method comprises the following steps: 1, establishing a feature map of a robot according to information fed back to a robot sensor by an environment and a physical structure of the robot; 2, inputting the obtained feature map into a graph neural network, andtraining the graph neural network by using supervision information sensed by the robot in a training stage; 3, processing the perception state information by using the trained graph neural network toobtain updated robot state information, and predicting the state information of the robot at the next moment; and 4, using the established environment model and a model prediction control algorithm tomake a decision on the robot action in the next step. According to the method, the reinforcement learning model based on the graph network is used, actions which cannot be well completed by previousreinforcement learning are successfully completed, the stability and reliability of robot autonomous control are improved, and the robot autonomous control is more convenient for practical application.

Description

technical field [0001] The invention relates to the field of robot simulation and intelligent control, in particular to a robot autonomous control method based on graph neural network reinforcement learning. Background technique [0002] Robot automatic control refers to a technology in which the robot can perform forward, turning, obstacle avoidance and other actions without human intervention, so that the robot can realize intelligent autonomous control to a certain extent. The robot perceives its own state through the sensors carried by itself in the environment, and through the intelligent program compiled in advance, it makes autonomous action decisions according to the current state. The traditional autonomous control of robots generally performs preset feedback operations on the values ​​of specific sensors, and cannot achieve true autonomous control for more complex tasks. [0003] In order to solve the autonomous control of the robot under complex tasks, researcher...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): B25J9/16G06N3/04G06N3/08
CPCB25J9/163B25J9/1605G06N3/08G06N3/045
Inventor 俞俊姚宗贵
Owner HANGZHOU DIANZI UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com