Intelligent QoS routing optimization method and system based on deep reinforcement learning in SDN environment

A technology of reinforcement learning and optimization methods, applied in the field of network routing optimization, can solve problems such as difficulty in coping with the network environment and high computational overhead

Active Publication Date: 2021-03-12
ANHUI UNIVERSITY
View PDF3 Cites 14 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Approximately fitting the current network state by modeling, and using a heuristic method to request real-time calculation of routing configuration for multimedia streams, the disadvantage is that it has strict applicable scenarios, and the calculation overhead is huge, making it difficult to cope with t

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Intelligent QoS routing optimization method and system based on deep reinforcement learning in SDN environment
  • Intelligent QoS routing optimization method and system based on deep reinforcement learning in SDN environment
  • Intelligent QoS routing optimization method and system based on deep reinforcement learning in SDN environment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0126] Experimental environment: the SDN controller in this embodiment uses Floodlight1.2, the network topology is constructed using the network emulator Mininet2.3, and the Python program is used to realize the agent of deep reinforcement learning, and the Iperf tool is selected to simulate the transmission of network services.

[0127] Network topology: such as Figure 9 As shown, the real NSFNET network is deployed in the Mininet network simulation software, which contains 13 switch nodes and 20 links. Among them, node 0 is used as the source node, connected to the video server, and 8, 9, 11, 12, 13 are used as 5 Nodes connected to clients, 2, 4, and 7 are congested nodes.

[0128] Experimental parameters: The server (server) is responsible for sending video traffic, the video bit rate is set to 1Mbps, and the maximum delay and jitter allowed during transmission are set to 150ms and 30ms respectively. In deep reinforcement learning, the neural network parameters are set as...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an intelligent QoS routing optimization method and system based on deep reinforcement learning in an SDN environment, and the method comprises the following steps: expressing all streaming media services in a network as a service request set, and then for each request, searching a path meeting the network service quality from a streaming media server to a heterogeneous client; sequentially determining the route of each flow request, and finally constructing a multicast tree by adopting a QoS route optimization algorithm. For a network congestion link or a malicious node, the most suitable next node at present can be found for routing through a deep reinforcement learning method. By adopting the method of combining deep learning and reinforcement learning, the transmission delay of the video stream can be effectively reduced, and the accuracy of routing decision can be improved. Meanwhile, the design of a distributed control plane is adopted and can be realized in various network topologies, so that the network congestion can be avoided, the expandability of the network is improved, the interaction with a single controller is reduced, and the overall utilityof the network is improved.

Description

technical field [0001] The invention belongs to network routing optimization technology, in particular to an intelligent QoS routing optimization method and system based on deep reinforcement learning in an SDN environment. Background technique [0002] In recent years, with the vigorous development of the Internet, there have been more and more network applications, and network traffic has exploded. With the rapid growth of the network scale and the number of users, the network structure is becoming more and more complex, and network security and route optimization are facing more and more challenges. At the same time, new network application services for heterogeneous end users have emerged. For example, multimedia streaming applications such as Internet TV, online games, and video conferencing have become more and more popular on the Internet. The sharp increase in network data has led to network management equipment Variables are complex. With the improvement of the fl...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04L12/725H04L12/721H04L12/761H04L12/801H04L12/46G06N3/08H04L45/16
CPCH04L45/302H04L45/14H04L45/16H04L12/4633H04L47/12G06N3/08
Inventor 孔令彪崔杰杨明仲红许艳马建峰
Owner ANHUI UNIVERSITY
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products