Transfer learning method based on scene template generation

A technology of template generation and transfer learning, applied in the field of intelligent robots, can solve problems such as large limitations

Pending Publication Date: 2020-10-23
BEIJING INST OF CONTROL ENG
View PDF0 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0007] The above two methods have grea

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Transfer learning method based on scene template generation
  • Transfer learning method based on scene template generation
  • Transfer learning method based on scene template generation

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0033] The present invention provides a migration learning method based on scene template generation, which constructs a bridge between a mathematical simulation environment and a physical environment and different physical environments, and ensures that the strategy network trained in the mathematical simulation environment can seamlessly migrate to the real physical environment. As well as migrating between different physical environments, the skills learned in one environment can be applied in another environment. It mainly includes the following steps:

[0034] (1) Design scene template

[0035] The composition of the scenario template is designed according to mission requirements and mission scenarios. For example, the physical scenario of the on-orbit refueling operation includes space robots, the active end of the refueling system, the receptor satellite, the passive end of the refueling system, and others. The space robot, the active end of the filling system, the receptor...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a migration learning method based on scene template generation. The method comprises the steps of designing a scene template, constructing the scene template, training a template generation network and migrating a strategy network based on the scene template. According to the method, the unified template of different scenes is established through the concept of the scene template, the common characteristics of the different scenes are constructed, and the relationship between the different scenes is established through the common characteristics, so that the migrationof the strategy network obtained through reinforcement learning between the environments with relatively large differences is realized.

Description

technical field [0001] The invention relates to a migration learning method based on scene template generation, which belongs to the field of intelligent robots, and is used to realize the seamless migration of the strategy network trained by the robot in the mathematical simulation environment to the real physical environment, and to migrate between different physical environments to realize Skills learned in one setting can be applied in another. Background technique [0002] Research on "self-learning" space operation robots based on deep reinforcement learning methods refers to endowing robots with self-learning capabilities, and training robots to master various operating skills through "imitation" and autonomous training, so as to solve the unstructured environment that plagues current space operations , teleoperation and long delay are important research directions in the field of robotics. [0003] Robot self-training requires robots to learn operational skills thro...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/62G06N3/04G06N20/00
CPCG06N20/00G06N3/045G06F18/214Y02T10/40
Inventor 王勇解永春陈奥李林峰胡勇唐宁
Owner BEIJING INST OF CONTROL ENG
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products