Network flow load balancing control method based on reinforcement learning

A network traffic and load balancing technology, applied in data exchange networks, digital transmission systems, electrical components, etc., can solve problems such as poor security, complex configuration, and large bandwidth consumption, and achieve the effect of ensuring reliability.

Inactive Publication Date: 2012-07-11
ELECTRIC POWER RES INST OF GUANGDONG POWER GRID
View PDF1 Cites 28 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The RIP algorithm is too simple, poor in security, and consumes a lot of bandwidth, so it is not suitable for large-scale networks; the OSPF algorithm is a link-state routing protocol. Compared with the RIP algorithm, it has the advantages of fast convergence, low protocol overhead, high security, and wide adaptability. Its configuration is complicated, and its routing load balancing ability is weak; the EIGRP algorithm is an enhanced gateway internal routing protocol, which has many advantages, but it belongs to Cisco's private protocol

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Network flow load balancing control method based on reinforcement learning
  • Network flow load balancing control method based on reinforcement learning
  • Network flow load balancing control method based on reinforcement learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0033] Figure 4 It shows a flowchart of the data packet learning process of the network traffic load balancing control method based on reinforcement learning of the present invention.

[0034] The framework of network traffic load balancing algorithm based on reinforcement learning is as figure 1 Shown. The general process is: the data packet first adopts action a t , And affect the environment; because the data packet takes an action, its state must change, that is, by s t To s t+1 , (The change of the state can be considered as the environment perceives this change, and the state changes); the environment feedbacks the action of the data packet and gives rewards and punishments (r in the figure) t+1 ); When the data packet receives rewards and punishments, it will reflect on its own behavior and update its own strategy (this is not shown in the figure); back to the first step, it is indicated by the dotted line in the figure. Specifically, the learning process of the data pack...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a network flow load balancing control method based on reinforcement learning, which comprises the following steps of: 1) selecting an action ai with a maximal return value from an action set of the next hop according to the state quantity s and the strategy pi of a current data packet when the data packet is in a routing node R*; 2) modifying the state quantity s of the data packet according to actual conditions of the data packet after the current data packet is routed, and updating the action set of the next hop of the current data packet; 3) modifying the rewards and punishment values r of the current data packet according to balancing states of the current network flow; and 4) updating the strategy pi according to the rewards and punishment values; and repeating the step 1) to the step 4) when the current data packet reaches a final destination address. According to the method, optimal or approximately optimal control on load balancing of the network flow is realized by unceasing interactive learning of an intelligent agent and the network environment.

Description

Technical field [0001] The invention relates to the technical field of network traffic load balancing, and specifically refers to providing an intelligent network traffic load balancing control method based on reinforcement learning. Background technique [0002] With the rapid development of the network, various network applications are emerging one after another, and the traffic on the corresponding network is also increasing. According to authoritative surveys, network quality of service (Qos: Quality of Service), especially network response time, is the main factor that affects user experience. Therefore, reasonable network design and network service quality are issues that every network engineer needs to consider . There are many solutions to ensure the quality of service of the network. The present invention proposes a network traffic load balancing algorithm based on reinforcement learning. Data packets can use the reinforcement learning algorithm to select a suitable for...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04L12/56H04L47/76
Inventor 胡朝辉梁智强梁志宏周强峰江泽鑫石炜君梁毅成
Owner ELECTRIC POWER RES INST OF GUANGDONG POWER GRID
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap