Distributed data transmission method and system based on load balancing

A distributed data and load balancing technology, applied in digital transmission systems, transmission systems, data exchange networks, etc., can solve problems such as node failure, data loss, and excessive node load, and achieve the effect of improving efficiency

Active Publication Date: 2015-08-19
AEROSPACE INFORMATION
View PDF5 Cites 27 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

With the increase of nodes, the probability of node failure, node overload, etc. will greatly increase, and these situations will lead to data loss
These distributed data transmission systems can only find the problem when one of the nodes fails, and the data cached on the node may not be retrieved at this time
At the same time, the network transmission rate of these distributed data transmission systems is also a great restrictive factor. When multiple nodes in the previous node transmit data in parallel to a node in the next node at the same time, the node in the next node may not be able to process the received data, thus cause data loss

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed data transmission method and system based on load balancing
  • Distributed data transmission method and system based on load balancing
  • Distributed data transmission method and system based on load balancing

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0042] In view of the above analysis, the embodiment of the present invention proposes a distributed data transmission method with a load balancing mechanism, by introducing a load balancing management node to monitor the data transmission process, and according to factors such as data transmission rate and node status. The data transmission process is adjusted in real time to ensure the security of data transmission and improve the fault tolerance of data transmission.

[0043] A schematic diagram of the network topology of a distributed data transmission system based on a load balancing mechanism provided in this embodiment is as follows: figure 1 shown. exist figure 1 In the shown distributed data transmission system, each transmission node is divided into multiple levels, and each level includes multiple transmission nodes. In the distributed data transmission system, a load balancing management node is also set up. The load balancing management node communicates with ea...

Embodiment 2

[0059] A load balancing management node provided by this embodiment handles the node failure problem of the transmission node as follows, including the following processing steps:

[0060] 1. Each transmission node regularly sends a heartbeat message carrying node status information to the management node through RPC communication. The above node status information includes node network traffic rate, node maximum bandwidth, CPU load, memory usage, node cache data size in the entire cache size of space;

[0061] 2. The load balancing management node obtains the node status information carried in the heartbeat information sent by each transmission node, and stores the node status information in the database;

[0062] 3. When the transmission node A does not send heartbeat information to the load balancing management node within a period of time, the load balancing management node judges that the transmission node A is a failure node;

[0063] 4. The load balancing management no...

Embodiment 3

[0075] This embodiment provides a distributed data transmission system based on load balancing, and its specific implementation structure is as follows image 3 As shown, it may specifically include: multiple transmission nodes and a load balancing management node, each transmission node is divided into multiple levels, and each level includes multiple transmission nodes;

[0076] The load balancing management node is used for data communication with each transmission node, receiving node status information sent by each transmission node; according to the received node status information of each transmission node, according to the set load balancing strategy Control the data transmission flow between each transmission node.

[0077] Specifically, the transmission node is used to set the heartbeat module to obtain the node status information of the transmission node itself in real time; according to the set time interval, the heartbeat module uses the remote procedure call prot...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention provides a distributed data transmission method and system based on load balancing. The method mainly comprises the steps that: transmission nodes in the distributed data transmission system are divided into a plurality of levels, each level comprises a plurality of transmission modes, a load balancing management node is set in the distributed data transmission system, and the load balancing management node controls data transmission flow among all the transmission nodes according to received node state information of each transmission node and a set load balancing strategy. According to the invention, effective detection and management over the whole data transmission process are realized, the data transmission flow among all the transmission nodes can be controlled according to the received node state information of each transmission node and the set load balancing strategy, and the network architecture of the distributed data transmission system is adjusted in real time, so that the data transmission efficiency of the distributed data transmission system is improved.

Description

technical field [0001] The present invention relates to the technical field of distributed data transmission, in particular to a distributed data transmission method and system based on load balancing. Background technique [0002] In recent years, with the rapid development of information technology, the amount of network data has grown very rapidly. At the same time, the development of cloud computing and Internet of Things technology has also produced a large amount of network data. A large part of these network data requires long-distance and long-term network transmission. For example, a cloud computing platform for data mining needs to collect data from various collection points and transmit them to the cloud platform. The urban traffic management system based on the Internet of Things needs to collect data from various key nodes in the city in real time, and store, merge, and process the data in real time. [0003] At present, there are two main types of long-dista...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04L12/803H04L29/08
Inventor 林文辉
Owner AEROSPACE INFORMATION
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products