Unlock instant, AI-driven research and patent intelligence for your innovation.

Robot imitation learning method based on Gaussian process

A Gaussian process and learning method technology, applied in the field of intelligent products, can solve problems such as unsuitable imitation learning tasks

Inactive Publication Date: 2017-05-31
HARBIN INST OF TECH GENIUS INTELLIGENTTECH
View PDF0 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0002] By observing and imitating the behavior of their peers, humans and other creatures can effectively obtain the movement patterns of their peers and understand the meaning of these behaviors, endowing robots with the ability to imitate and learn like humans, which can effectively solve the problem of robot motor skill acquisition. Improving the learning efficiency and self-adaptive ability of robots is an important research direction of robot bionics research; the general learning form of imitation learning is action copying, which is mainly based on the movement trajectory of the teacher. The regression problem of executive action is to determine the control strategy. The imitator executes the control strategy to reproduce the behavior and realize the imitation learning. Most of the imitation learning algorithms use the inverse reinforcement learning algorithm to find the control strategy. The cost function of teaching behavior to imitate learning, and seek the control strategy that minimizes the cost function. However, the method of inverse reinforcement learning has high requirements on the cost function, and is not suitable for imitation learning tasks where the cost function is difficult to obtain

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0015] A robot imitation learning method based on Gaussian process, including the following steps:

[0016] Step 1: The teaching robot adopts the non-cross-connection method of the Braitenberg car. The output value of the light sensor is inversely proportional to the corresponding motor output value. The position of the light source is arbitrarily set. The imitation robot also adopts the non-cross-connection method of the Braitenberg car. The light sensor The relationship between the output value and the corresponding motor output value is unknown and needs to be given by imitation learning strategy;

[0017] The second step: teach the robot to demonstrate the action, complete the phototaxis action, and randomly select sample points to form a sample point set, each sample point contains two parameters;

[0018] The third step: use the Gaussian process method to train the sample point set, establish and solve its Gaussian process model, and obtain the mapping relationship betwe...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a robot imitation learning method based on the Gaussian process. The method comprises the first step of arbitrarily setting a light source position; the second step of carrying out the action demonstration by a teaching robot to complete the phototaxis action; the third step of using a Gaussian process method to train a sample point set and establishing and solving a Gaussian process model; the fourth step of applying a mapping relation to a self control strategy by an imitation robot, and carrying out imitation learning of the action of the teaching robot; and the fifth step of carrying out imitation action analysis. The robot imitation learning method based on the Gaussian process applies the Gaussian process to research on the robot imitation learning control strategy algorithm. By collecting the teaching behavior sample points of the teaching robot, the Gaussian process algorithm is used to train the sample points, the mapping relation between the teaching robot's perception and behavior is learned, and the mapping relation is applied to the imitation learning control strategy of the imitation robot and then execution is conducted.

Description

technical field [0001] The invention relates to a robot imitation learning method, in particular to a robot imitation learning method based on a Gaussian process, and belongs to the technical field of intelligent products. Background technique [0002] Humans and other creatures can effectively acquire the movement patterns of their companions’ behaviors by observing and imitating the behaviors of their peers, and understand the meaning of these behaviors, giving robots the ability to imitate and learn like humans, and can effectively solve the problem of robot motor skills acquisition, Improving the learning efficiency and adaptive ability of robots is an important research direction of robot bionics research; the general learning form of imitation learning is action replication. The regression problem of executing the action is to determine the control strategy. The imitator executes the control strategy to reproduce the behavior and realizes imitation learning. Most of th...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G05B13/04
Inventor 常琳
Owner HARBIN INST OF TECH GENIUS INTELLIGENTTECH