Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Robot control method and equipment

A control method and robot technology, which are applied in the computer field to achieve an optimal global solution and improve the learning convergence speed.

Active Publication Date: 2020-09-11
ZHENGZHOU UNIV
View PDF4 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0007] One purpose of this application is to provide a robot control method and equipment to solve the problem of how to adjust the degree of exploration and utilization in the process of robot learning in the prior art, so as to improve the learning convergence speed and obtain a better global solution

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Robot control method and equipment
  • Robot control method and equipment
  • Robot control method and equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0041] The application will be described in further detail below in conjunction with the accompanying drawings.

[0042] In a typical configuration of the present application, the terminal, the device serving the network, and the trusted party all include one or more processors (such as a central processing unit (Central Processing Unit, CPU), an input / output interface, a network interface, and a memory.

[0043]Memory may include non-permanent memory in computer-readable media, random access memory (Random Access Memory, RAM) and / or non-volatile memory, such as read-only memory (Read Only Memory, ROM) or flash memory (flash RAM). Memory is an example of computer readable media.

[0044] Computer-readable media, including both permanent and non-permanent, removable and non-removable media, can be implemented by any method or technology for storage of information. Information may be computer readable instructions, data structures, modules of a program, or other data. Example...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The purpose of the application is to provide a robot control method and equipment. The exploration speed is dynamically adjusted by simulating an anterior cingulate cortex nerve adjustment mechanism in the brain physiological mechanism of primates, and the exploration and utilization degree is adjusted in real time according to the environment, so that the dynamic balance between the utilization environment and the exploration environment of the robot is realized, the learning convergence speed in the behavior decision process of the robot is improved, and a better global solution is obtained.

Description

technical field [0001] The present application relates to the field of computers, in particular to a robot control method and equipment. Background technique [0002] In the existing technology, the robot needs to learn and adapt to the environment in an unknown environment, and reinforcement learning is one of the key technologies. The advantage of reinforcement learning is that it does not need to give the expected output, but according to the reinforcement signal through online interactive training, the robot can obtain the maximum cumulative return when moving in the environment, so as to obtain a better control strategy. Therefore, reinforcement learning is often used in the research of robot behavior decision-making. [0003] At present, an important problem faced by reinforcement learning algorithms is the balance between environment exploration and environment utilization. The coordination state of exploration and utilization directly affects the efficiency of reinf...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): B25J9/16
CPCB25J9/1602B25J9/163B25J9/1664
Inventor 王东署胡宇航罗勇辛健斌王河山马天磊贾建华张方方陈书立
Owner ZHENGZHOU UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products