Cluster management method and device
A cluster management and cluster technology, applied in the field of communication, can solve the problems of business delay and long cluster restart time, and achieve the effect of reducing business delay
Active Publication Date: 2019-07-30
NEW H3C SECURITY TECH CO LTD
View PDF4 Cites 10 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
[0003] When a new node is connected to the master node, or a slave node is separated from the master node, the master node needs to rebalance the load of each node in the cluster, that is, recalculate the hash value of each node, and the corresponding The hash value of the key value to be monitored (key), because the parameters used in calculating the hash value include the number of nodes, and the number of nodes changes, so the calculated hash value of each node and the value of each key value to be monitored The hash values all change, which in turn leads to changes in the data that each node needs to monitor after re-balancing the load, resulting in more data migration and other work, resulting in a longer cluster restart time and business delays
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0073] The following will clearly and completely describe the technical solutions in the embodiments of the application with reference to the drawings in the embodiments of the application. Apparently, the described embodiments are only some of the embodiments of the application, not all of them. Based on the embodiments in this application, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the scope of protection of this application.
[0074] For the convenience of understanding, firstly, the application scenario of the embodiment of the present application will be described. Applying the method of the embodiment of the present application, after the cluster is started or restarted, if there is no master node in the cluster, the master node will be elected. Or, during the cluster operation, each slave node in the cluster will periodically receive the heartbeat message sent by the master node to determine whether th...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The embodiment of the invention provides a cluster management method and device, relates to the technical field of communication. The method and the device are used for solving the problem of relatively long service delay caused by a restarting process when a new node or a separation node in a cluster needs to be restarted. According to the scheme, the method comprises: acquiring a survival node list, the survival node list comprising internet protocol IP addresses of all nodes connected with a main node, and then calculating hash values of the IP addresses of all the nodes in the survival node list; according to the hash value of the IP address of each node, respectively mapping each node to a position on a Hash ring, then obtaining a to-be-monitored key value corresponding to to-be-monitored data, determining a Hash value corresponding to each to-be-monitored key value, and then mapping the Hash value corresponding to each to-be-monitored key value to the position of the Hash ring soas to determine the monitoring range of each node.
Description
technical field [0001] The present application relates to the field of communication technologies, and in particular to a cluster management method and device. Background technique [0002] In the era of the Internet of Everything, huge amounts of data formatting is the basis for big data analysis and machine learning. The Fluentd log collection framework is a data collection tool with functions such as data collection, filtering, processing, and writing. Various complex processing of data. At present, in the face of massive data in the big data environment, there has been a multi-Fluentd instance technology based on consistency, that is, the cluster includes multiple Fluentd nodes, one Fluentd node is the master node, and the rest of the Fluentd nodes can be connected to the master node as slave nodes . [0003] When a new node is connected to the master node, or a slave node is separated from the master node, the master node needs to rebalance the load of each node in th...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More IPC IPC(8): H04L29/08H04L12/26
CPCH04L43/10H04L67/1001
Inventor 陶勇森
Owner NEW H3C SECURITY TECH CO LTD