Robot motion decision-making method, system, and device introducing emotion regulation mechanism

A technology of robot movement and decision-making method, applied in the field of intelligent robots, to achieve the effect of improving decision-making speed

A technology of robot movement and decision-making method, applied in the field of intelligent robots, to achieve the effect of improving decision-making speed

CN110119844BActive Publication Date: 2021-02-12INST OF AUTOMATION CHINESE ACAD OF SCI

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Robot motion decision-making method, system, and device introducing emotion regulation mechanism
  • Robot motion decision-making method, system, and device introducing emotion regulation mechanism
  • Robot motion decision-making method, system, and device introducing emotion regulation mechanism

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0046] In order to make the purpose, technical solutions and advantages of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the accompanying drawings. Obviously, the described embodiments are part of the embodiments of the present invention, rather than Full examples. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0047] The application will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain related inventions, not to limit the invention. It should also be noted that, for the convenience of description, only the parts related to the related invention are sho...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention belongs to the field of intelligent robots, and specifically relates to a robot motion decision-making method, system, and device introducing an emotion regulation mechanism, aiming at solving the problems of robot decision-making speed and learning efficiency. The system method includes using the environmental perception model to generate the predicted state value at the next moment according to the current action variable and state value; based on the action variable, state value, and immediate reward, update the state-action value function network; obtain the predicted trajectory based on the environmental perception model , calculate the local optimal solution of the predicted trajectory, and perform differential dynamic programming to obtain the optimal decision based on the model; according to the current state and strategy, minimize the state-action value function to obtain a model-free decision; based on the state prediction error and reward prediction error And the average reward value, the emotional response signal is generated through the computational model of emotional processing, and the path decision is selected according to the threshold of the signal. The present invention gradually improves the decision-making speed while ensuring the learning efficiency.

Description

technical field [0001] The invention belongs to the field of intelligent robots, and in particular relates to a robot motion decision-making method, system and device introducing an emotion regulation mechanism. Background technique [0002] A huge challenge in the current robot development is: how to learn to reason about potential dynamic changes in the environment, and learn how to effectively learn a new knowledge or skill. At present, scientists widely draw on the working mechanism of the human brain to establish a series of brain-inspired computing models in an attempt to achieve human-like intelligence. [0003] The decision-making process is a high-level cognitive processing process in the brain. A large amount of neuroscience data shows that there are two distinct decision-making systems in the human brain system: one is a declarable model-based decision-making system, which is mainly used to complete A series of goal-oriented behaviors; the other is a reflexive mo...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
12 Feb 2021
Publication
CN110119844B
IPC
G06Q10/04; G06Q10/06; G06N3/04; G06N3/06; G06N3/08
CPC
G06Q10/04; G06Q10/0637; G06N3/061; G06N3/08; G06N3/045
Inventors
黄销; 吴伟