Robot motion decision-making method, system, and device introducing emotion regulation mechanism

A technology of robot movement and decision-making method, applied in the field of intelligent robots, to achieve the effect of improving decision-making speed

Active Publication Date: 2021-02-12
INST OF AUTOMATION CHINESE ACAD OF SCI
View PDF1 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] In order to solve the above-mentioned problems in the prior art, that is, in order to solve the scheduling process between model-based decision-making and model-free decision-making, and to balance the problem between decision-making speed and learning efficiency, the first aspect of the present invention proposes a method that introduces emotion regulation Mechanism-based robot motion decision-making method, the method includes:

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Robot motion decision-making method, system, and device introducing emotion regulation mechanism
  • Robot motion decision-making method, system, and device introducing emotion regulation mechanism
  • Robot motion decision-making method, system, and device introducing emotion regulation mechanism

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0046] In order to make the purpose, technical solutions and advantages of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the accompanying drawings. Obviously, the described embodiments are part of the embodiments of the present invention, rather than Full examples. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0047] The application will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain related inventions, not to limit the invention. It should also be noted that, for the convenience of description, only the parts related to the related invention are sho...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention belongs to the field of intelligent robots, and specifically relates to a robot motion decision-making method, system, and device introducing an emotion regulation mechanism, aiming at solving the problems of robot decision-making speed and learning efficiency. The system method includes using the environmental perception model to generate the predicted state value at the next moment according to the current action variable and state value; based on the action variable, state value, and immediate reward, update the state-action value function network; obtain the predicted trajectory based on the environmental perception model , calculate the local optimal solution of the predicted trajectory, and perform differential dynamic programming to obtain the optimal decision based on the model; according to the current state and strategy, minimize the state-action value function to obtain a model-free decision; based on the state prediction error and reward prediction error And the average reward value, the emotional response signal is generated through the computational model of emotional processing, and the path decision is selected according to the threshold of the signal. The present invention gradually improves the decision-making speed while ensuring the learning efficiency.

Description

technical field [0001] The invention belongs to the field of intelligent robots, and in particular relates to a robot motion decision-making method, system and device introducing an emotion regulation mechanism. Background technique [0002] A huge challenge in the current robot development is: how to learn to reason about potential dynamic changes in the environment, and learn how to effectively learn a new knowledge or skill. At present, scientists widely draw on the working mechanism of the human brain to establish a series of brain-inspired computing models in an attempt to achieve human-like intelligence. [0003] The decision-making process is a high-level cognitive processing process in the brain. A large amount of neuroscience data shows that there are two distinct decision-making systems in the human brain system: one is a declarable model-based decision-making system, which is mainly used to complete A series of goal-oriented behaviors; the other is a reflexive mo...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06Q10/04G06Q10/06G06N3/04G06N3/06G06N3/08
CPCG06Q10/04G06Q10/0637G06N3/061G06N3/08G06N3/045
Inventor 黄销吴伟乔红
Owner INST OF AUTOMATION CHINESE ACAD OF SCI
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products