Robot motion decision-making method, system and device introducing emotion regulation and control mechanism

A technology of robot movement and decision-making method, applied in the field of intelligent robots, to achieve the effect of improving decision-making speed

Active Publication Date: 2019-08-13
INST OF AUTOMATION CHINESE ACAD OF SCI
View PDF1 Cites 34 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] In order to solve the above-mentioned problems in the prior art, that is, in order to solve the scheduling process between model-based decision-making and model-free decision-making, and to balance the problem ...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Robot motion decision-making method, system and device introducing emotion regulation and control mechanism
  • Robot motion decision-making method, system and device introducing emotion regulation and control mechanism
  • Robot motion decision-making method, system and device introducing emotion regulation and control mechanism

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0046] In order to make the purpose, technical solutions and advantages of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the accompanying drawings. Obviously, the described embodiments are part of the embodiments of the present invention, rather than Full examples. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0047] The application will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain related inventions, not to limit the invention. It should also be noted that, for the convenience of description, only the parts related to the related invention are sho...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention belongs to the field of intelligent robots, particularly relates to a robot motion decision-making method, system and device introducing an emotion regulation and control mechanism, andaims to solve the problems of robot decision-making speed and learning efficiency. The method comprises the following steps: generating a predicted state value of a next moment according to a currentaction variable and a state value by utilizing an environmental perception model; updating state-based on action variables, state values, immediate rewards An action value function network; obtaininga prediction track based on an environmental perception model, calculating a local optimal solution of the prediction track, carrying out differential dynamic programming, and obtaining an optimal decision based on the model; acquiring a model-free decision based on a current state and strategy as well as minimized state-motion functions and based on the state prediction error, the reward prediction error and the average reward value, generating an emotion response signal through an emotion processing computable model, and selecting a path decision according to a threshold value of the signal.The decision-making speed is gradually increased while learning efficiency is ensured.

Description

technical field [0001] The invention belongs to the field of intelligent robots, and in particular relates to a robot motion decision-making method, system and device introducing an emotion regulation mechanism. Background technique [0002] A huge challenge in the current robot development is: how to learn to reason about potential dynamic changes in the environment, and learn how to effectively learn a new knowledge or skill. At present, scientists widely draw on the working mechanism of the human brain to establish a series of brain-inspired computing models in an attempt to achieve human-like intelligence. [0003] The decision-making process is a high-level cognitive processing process in the brain. A large amount of neuroscience data shows that there are two distinct decision-making systems in the human brain system: one is a declarable model-based decision-making system, which is mainly used to complete A series of goal-oriented behaviors; the other is a reflexive mo...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06Q10/04G06Q10/06G06N3/04G06N3/06G06N3/08
CPCG06Q10/04G06Q10/0637G06N3/061G06N3/08G06N3/045
Inventor 黄销吴伟乔红
Owner INST OF AUTOMATION CHINESE ACAD OF SCI
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products