Group intelligence collaboration method for communication mechanism optimization

A technology of swarm intelligence and communication mechanism, applied in the field of multi-agent deep reinforcement learning, to achieve the effect of easy implementation, simple and clear structure, and good performance

Pending Publication Date: 2021-11-12
TAIYUAN UNIV OF TECH
View PDF0 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This type of method does not involve communication channels to complete the transmission of communication messages, resulting in the strategy network can only rely on its own observations to make decisions during the execution process, and cannot promote collaboration with other agents through communication

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Group intelligence collaboration method for communication mechanism optimization
  • Group intelligence collaboration method for communication mechanism optimization
  • Group intelligence collaboration method for communication mechanism optimization

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0033] Such as figure 1 with figure 2 As shown, a kind of swarm intelligence collaborative method of communication mechanism optimization of the present invention comprises the following steps:

[0034] Step 1: Build a strategy network in which each agent is responsible for its own decision-making, where the strategy network part includes a shared storage communication network;

[0035] Step 2: Build a judgment network shared by multiple agents;

[0036] Step 3: Centrally train the agent system: generate local messages for the observation of a single agent, generate personalized global messages for each agent through the attention mechanism, and pass them to the agent's strategy network to complete the agent's network. exchange of information between

[0037] Step 4: The policy network makes decisions based on the agent's local observations and global communication messages;

[0038]Step 5: The evaluation network measures the value of each agent's action based on the agen...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a group intelligence collaboration method for communication mechanism optimization, and belongs to the technical field of group intelligence collaboration methods for communication mechanism optimization. The technical problem to be solved is to provide the improvement of the swarm intelligence collaboration method for communication mechanism optimization. According to the technical scheme for solving the technical problem, a centralized training and decentralized execution framework is adopted, a centralized evaluation network is adopted to measure the behavior value of the intelligent agent according to global state information, and the influence of the action of a single intelligent agent on the overall benefit is evaluated based on a time difference advantage strategy gradient; a shared storage communication mechanism is introduced into a strategy network part, local messages are generated for observation of a single agent, personalized global messages are generated for each agent through an attention mechanism and transmitted to strategy networks of the agents, and information exchange between the agents is completed; and the strategy network makes decisions according to agent local observation and global communication messages. The method is applied to the field of group collaboration.

Description

technical field [0001] The invention relates to a group intelligence collaboration method for communication mechanism optimization, which belongs to the field of multi-agent deep reinforcement learning. Background technique [0002] With the continuous advancement of science and technology, the combination of reinforcement learning (RL: Reinforcement Learning) and deep learning (DL: Deep Learning) has formed the field of deep reinforcement learning (DRL: Deep Reinforcement Learning). , automatic driving and logistics deployment and other scenarios, it shows a level beyond human beings. Due to the limited autonomous decision-making ability of a single agent, it often cannot have a great impact on the environment, and it is not suitable for scenarios that require multiple agents to cooperate to achieve a common goal. Therefore, researchers created the field of Multi-Agent Reinforcement Learning (MARL: Multi-Agent Reinforcement Learning) by applying DRL to multi-agent systems....

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F30/27G06F30/18G06N3/04G06N3/08
CPCG06F30/27G06F30/18G06N3/04G06N3/08
Inventor 王莉臧嵘
Owner TAIYUAN UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products