Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

SDN network intelligent routing data transmission method based on distributed deep reinforcement learning

A data transmission method and reinforcement learning technology, applied in the field of distributed deep reinforcement learning SDN network intelligent routing data transmission, can solve problems such as poor timeliness, unbalanced network load, and low throughput

Active Publication Date: 2020-11-10
UNIV OF ELECTRONICS SCI & TECH OF CHINA
View PDF17 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

A single metric and optimization goal can easily lead to congestion of some key links, resulting in unbalanced network load
Although the shortest routing algorithm based on Lagrangian relaxation can find the optimal path with complex multi-constraint conditions when assigning multiple service paths, this type of heuristic routing algorithm must go through multiple iterations to calculate the optimal path, and the convergence speed Slow, poor timeliness, low throughput

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • SDN network intelligent routing data transmission method based on distributed deep reinforcement learning
  • SDN network intelligent routing data transmission method based on distributed deep reinforcement learning
  • SDN network intelligent routing data transmission method based on distributed deep reinforcement learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0060] The specific embodiments of the present invention are described below so that those skilled in the art can understand the present invention, but it should be clear that the present invention is not limited to the scope of the specific embodiments. For those of ordinary skill in the art, as long as various changes Within the spirit and scope of the present invention defined and determined by the appended claims, these changes are obvious, and all inventions and creations using the concept of the present invention are included in the protection list.

[0061] Embodiments of the present invention will be described in detail below in conjunction with the accompanying drawings.

[0062] Such as figure 1 As shown, a distributed deep reinforcement learning SDN network intelligent routing data transmission method, including the following steps:

[0063] S1. Construct a reward function and a deep reinforcement learning model including actor network and evaluator network, and ar...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses an SDN (Software Defined Network) intelligent routing data transmission method based on distributed deep reinforcement learning, which realizes calculation of a fast routing path, maximizes throughput under the condition of ensuring delay, and solves the problems of low speed and small throughput of the traditional algorithm. According to the method, a reinforcement learning algorithm is used, the routing calculation process is simplified into simple input and output through the algorithm, multiple iterations during calculation are avoided, so that rapid calculation ofthe routing path is achieved, forwarding delay is reduced through acceleration of the speed of the routing algorithm, and data packets originally abandoned due to ttl expiration have higher probability of survival and are forwarded successfully so that network throughput is increased. During two training stages of offline training and online training is set, parameters are updated in a dynamic environment to select an optimal path, so that the invention has topology adaptability.

Description

technical field [0001] The invention belongs to the field of data transmission, and in particular relates to an SDN network intelligent routing data transmission method of distributed deep reinforcement learning. Background technique [0002] The current information technology has entered a mature stage. In the SDN network (Software Defined Network) architecture, the data flow is flexible and controllable, and the controller has a view of the entire network and can perceive network status changes in real time (such as traffic distribution, congestion status, and link utilization. situation, etc.), in reality, the routing problem is often solved by the shortest path algorithm, some simple network parameters (such as path hops, delay, etc.) The minimum path is taken as the final goal of the algorithm. A single metric and optimization goal can easily lead to congestion of some key links, resulting in unbalanced network load. Although the shortest routing algorithm based on La...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): H04L12/721H04L12/727H04L12/729G06N3/08H04L45/121H04L45/125
CPCH04L45/124G06N3/08H04L45/125H04L45/121
Inventor 刘宇涛崔金鹏章小宁贺元林
Owner UNIV OF ELECTRONICS SCI & TECH OF CHINA
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products