Routing decision method based on deep reinforcement learning under SDN framework and device thereof

An SDN architecture and reinforcement learning technology, applied in the field of communication, can solve the problem that the routing strategy cannot be optimized, and it is difficult to reduce network congestion, so as to reduce network congestion and realize the effect of routing strategy.

Active Publication Date: 2018-11-27
NOVNET COMPUTING SYST TECH CO LTD
View PDF11 Cites 42 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

And because it is difficult to reduce or avoid network congestion, in a network environment where network traffic is highly dynamic, the routing strategy based on ECMP technology cannot achieve optimal

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Routing decision method based on deep reinforcement learning under SDN framework and device thereof
  • Routing decision method based on deep reinforcement learning under SDN framework and device thereof
  • Routing decision method based on deep reinforcement learning under SDN framework and device thereof

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0030] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0031] In order to facilitate the understanding of the solution, the following first briefly introduces SDN (Software Defined Network, software-defined network), DRL (Deep Reinforcement learning, deep reinforcement learning) and DQN (DeepQ Network, deep Q network).

[0032] SDN is a new type of network architecture. Different from the traditional network architecture, SDN proposes the idea of ​​separating the data plane and control plane of the network. Among...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention provides a routing decision method based on deep reinforcement learning under an SDN framework and a device thereof. The method is applied to SDN controllers and comprises the following steps: obtaining real-time traffic information in a network; determining priority of each traffic; and inputting the real-time traffic information into a pre-trained deep Q network DQN and successively determining routing of each traffic according to priority level sequence of each traffic. The routing decision method based on deep reinforcement learning under an SDN framework and the device thereof are capable of achieving load balance of the networks in the networks of various topological structures, reducing the occurrence of network congestion and achieving optimization of routing policies in the network environment with highly dynamic change of the network traffic.

Description

technical field [0001] The invention relates to the field of communication technology, in particular to a routing decision method and device based on deep reinforcement learning under the SDN architecture. Background technique [0002] For a long time, congestion avoidance and route optimization have been important research topics in traffic engineering in modern communication networks. With the rapid growth of the number of users and network scale, the network structure is becoming more and more complex, and network congestion and route optimization are facing more and more challenges. [0003] The highly dynamically changing traffic services and unevenly distributed traffic density in the network are the main causes of network congestion. In order to solve the network congestion, the common solutions mainly include: performing multi-path distribution on the traffic that may cause the network congestion to prevent the excessive concentration of the load caused by the traff...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04L12/725H04L12/751H04L45/02
CPCH04L45/08H04L45/306
Inventor 潘恬黄韬杨冉张娇刘江谢人超杨帆刘韵洁
Owner NOVNET COMPUTING SYST TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products