Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Wireless routing optimization method based on attention mechanism and deep reinforcement learning

A technology of reinforcement learning and optimization method, applied in the field of wireless routing optimization based on deep reinforcement learning, can solve the problem that the existing reinforcement learning algorithm cannot be deployed, and achieve the effect of high scalability

Pending Publication Date: 2022-04-29
CHONGQING UNIV OF POSTS & TELECOMM
View PDF0 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] In order to make up for the limitations of traditional routing algorithms in complex network scenarios, and solve the problem that existing reinforcement learning algorithms cannot be deployed on resource-constrained terminal devices, the present invention proposes an algorithm based on attention mechanism and deep reinforcement learning. The wireless routing optimization method specifically includes the following steps:

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Wireless routing optimization method based on attention mechanism and deep reinforcement learning
  • Wireless routing optimization method based on attention mechanism and deep reinforcement learning
  • Wireless routing optimization method based on attention mechanism and deep reinforcement learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0058] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0059] The present invention provides a wireless routing optimization method based on deep reinforcement learning, comprising the following steps:

[0060] When each node accesses the network, it obtains the latest decision model parameters from the server, and listens to the neighbor node information;

[0061] The node builds a set of candidate parent nodes based on the information of listening neighbor nodes, and models the information of the m candidate par...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a network routing method, in particular to a wireless routing optimization method based on an attention mechanism and deep reinforcement learning, which comprises the following steps of: acquiring current latest decision model parameters from a server when each node accesses a network; neighbor node information is intercepted, a candidate father node set is constructed based on the candidate father node set, information modeling of m father nodes with the maximum energy is selected from the candidate father node set to serve as graph vectors to serve as input, graph vector features are extracted through an attention mechanism based on CNN, and the optimal father node is selected through deep reinforcement learning to serve as a relay node for data transmission of the optimal father node. After each data period is finished, the node counts related performance indexes of the data transmission node of the node; mapping the performance index into a corresponding reward value of the node under the corresponding state and action by adopting a same-degree quantization function, and transmitting experience information acquired in the data period to a server by the node; the method has relatively high expandability and can be applied to a node dynamic change scene in a network.

Description

technical field [0001] The invention relates to a network routing method, in particular to a wireless routing optimization method based on deep reinforcement learning. Background technique [0002] In recent years, the Internet of Things technology has continuously achieved new results, and has been applied to the fields of national defense and military, environmental detection, traffic management, medical and health care, manufacturing, disaster relief, etc. As one of the underlying technologies of the Internet of Things, the wireless sensor network has become an important Research hotspots in academia and industry. The routing protocol is the most important part of the wireless sensor network, and it is also one of the research hotspots at home and abroad. If you want to adapt to different working environments and complete corresponding tasks, the most important part is to design the corresponding routing protocol to make the network work. In various environments, it main...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): H04W40/10H04W40/12H04W24/02G06K9/62G06N3/04G06N3/08
CPCH04W40/10H04W40/12H04W24/02G06N3/08G06N3/045G06F18/214Y02D30/70
Inventor 尚凤军王颖代云龙
Owner CHONGQING UNIV OF POSTS & TELECOMM
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products