Priori knowledge guided robot operation skill learning system and method

A priori knowledge and learning system technology, applied in the direction of manipulators, program-controlled manipulators, manufacturing tools, etc., can solve the problems of long training time and low learning efficiency of robot skills, so as to reduce learning difficulty, improve flexibility and improve learning efficiency Effect

Active Publication Date: 2020-09-04
SHANDONG UNIV
View PDF4 Cites 10 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] However, the inventor found in the research that most of the current learning methods are completely explored from scratch, and the training time is longer, which reduces the efficiency of robot skill learning

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Priori knowledge guided robot operation skill learning system and method
  • Priori knowledge guided robot operation skill learning system and method
  • Priori knowledge guided robot operation skill learning system and method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0028] This embodiment discloses a robot operation skill learning system guided by prior knowledge, which applies expert experience knowledge and prior knowledge of operation process rules to a reinforcement learning method to reduce invalid exploration in the process of learning robot operation skills. Effectively improve learning efficiency and reduce learning difficulty.

[0029] figure 1 The robot operation skill learning system shown is divided into four parts: physical environment module, evaluation module, robot operation skill strategy learning module, and data storage area. The physical environment module includes robot, controller, sensor system (including vision system, force sensory system, joint sensing system, etc.). The sensing system mainly collects the main information of the robot's working environment, including: the end contact force of the manipulator, the motion state of the manipulator, and the image of the current assembly workpiece. The evaluation mod...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a priori knowledge guided robot operation skill learning system and method. The system comprises a physical environment module, an evaluation module and a robot operation skillpolicy learning module. The physical environment module collects robot operation environment information and a current operation state. The evaluation module evaluates a robot search operation policyby means of priori knowledge of an operation process and feeds back rewards and punishment values. The robot operation skill policy learning module learns an operation policy based on collected environment information, operation state and fed back rewards and punishment values to establish an expert knowledge base where operation contact states and actions of a mechanical arm are mapped one by oneso as to output a robot action decision, so that the learning efficiency is improved and the learning difficulty is reduced effectively.

Description

technical field [0001] The disclosure belongs to the technical field of machine learning, and in particular relates to a robot operation skill learning system and method guided by prior knowledge. Background technique [0002] The statements in this section merely provide background information related to the present disclosure and do not necessarily constitute prior art. [0003] Reinforcement learning has become the main method for learning robot operation skills. It imitates human learning methods, uses sensor feedback information, and continuously interacts with the environment to obtain external reward or punishment signals without explicit teaching. Adapt to changing circumstances and take appropriate actions. [0004] However, the inventor found in the research that most of the current learning methods are completely explored from scratch, and the training time is relatively long, which reduces the efficiency of robot skill learning. Contents of the invention [0...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): B25J9/16
CPCB25J9/163B25J9/1694B25J9/1602
Inventor 宋锐李凤鸣李贻斌王艳红刘义祥
Owner SHANDONG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products