Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Robot skill learning method and device, electronic equipment and storage medium

A robot and skill technology, applied in the computer field, can solve the problems of long learning time, difficult convergence, low success rate, etc., to achieve the effect of improving robustness, solving difficult convergence, and accurate learning

Active Publication Date: 2022-01-11
INST OF AUTOMATION CHINESE ACAD OF SCI
View PDF4 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Compared with traditional control methods, the current robot skill learning methods still have many problems and challenges in actual use, especially when faced with multi-stage complex tasks, it is prone to long learning time, difficult convergence, and low success rate. And other issues

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Robot skill learning method and device, electronic equipment and storage medium
  • Robot skill learning method and device, electronic equipment and storage medium
  • Robot skill learning method and device, electronic equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0074] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The following examples are for more clearly explaining the technical solutions of the present invention without limiting the scope of the invention.

[0075] The method of robot skill learning provided by the embodiment of the present invention can be applied to figure 1 In the system architecture shown, the system architecture includes a camera 100, a robot skill learning model 200.

[0076] Specifically, the camera 100 is used to acquire a plurality of consecutive equality intervals.

[0077] It should be noted that the environmental status includes robot status and task phase markers. The robot skill learning model 200 is used to obtain the operational description of the robot learning skills after entering a plurality of continuous equal intervals.

[0078] Further, the operation sequence of the robot performs by the operation description information sequence is described.

[0079] It should be noted that, in which the t...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a robot skill learning method and device, electronic equipment and a storage medium. The method comprises the following steps that: environment states of a plurality of continuous equal-interval moments are acquired, wherein the environment states comprise robot states and task stage identifiers; the environment states of the plurality of continuous equal-interval moments are input into a trained robot skill learning model to obtain an action description information sequence of a robot learning skill; and an action sequence executed by a robot is determined according to the action description information sequence. According to the method, the environment states of the multiple continuous equal-interval moments are input into the robot skill learning model to obtain the action description information sequence of the robot learning skill, so that robot skill learning is realized, the problems of difficulty in convergence and low success rate which are easily caused in the face of multi-stage complex tasks are solved, the robustness is improved, the robot skill learning efficiency is improved, and efficient and accurate learning of complex skills of the robot is realized.

Description

Technical field [0001] The present invention relates to computer technologies, and particularly relates to a method of robot learning skills, equipment, electronic equipment and a storage medium. Background technique [0002] At present, all kinds of intelligent autonomous robots have been widely used in manufacturing, marine and defense fields. With the development of robotics and artificial intelligence, robot autonomous capabilities continue to improve, we can replace the human complex tasks in more areas. [0003] As a broader application of the skills of a robot learning algorithm, the robot reinforcement learning and interactive learning environment maps from the state into action, and under the guidance of reward function, the best strategy to optimize the network, autonomous robot guidance to complete the assigned task. The traditional control method, the current robot learning skills still exist in actual use compared to many problems and challenges, especially in the fa...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06N3/00
CPCG06N3/008
Inventor 王睿张天栋王宇王硕
Owner INST OF AUTOMATION CHINESE ACAD OF SCI
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products