System and method for managing data in distributed cluster

A distributed cluster and data management technology, applied in digital transmission systems, transmission systems, data exchange networks, etc., can solve problems such as unfavorable load balancing, inability to fully utilize slave node capabilities, and multiple loads

Inactive Publication Date: 2011-04-20
ZTE CORP
View PDF3 Cites 58 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

When the master node generates data changes, it pushes the changed data to other slave nodes in the cluster, but there are two problems in this management method: 1) the master node bears too much load, which is not conducive to load balancing; 2) other The nodes are passively accepted, and the participation is low. At the same time, the master node treats each node the same, and cannot refer to the actual situation of the slave nodes, such as: performance, operating status, etc., and cannot fully utilize the capabilities of the slave nodes

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • System and method for managing data in distributed cluster
  • System and method for managing data in distributed cluster
  • System and method for managing data in distributed cluster

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0033] The basic idea of ​​the present invention is that the master node partitions the stored data, and selects a slave node as the responsible node for each data partition; the responsible node manages the data partitions that the responsible node is responsible for.

[0034] The technical solutions of the present invention will be further elaborated below in conjunction with the accompanying drawings and specific embodiments.

[0035] figure 1 It is a schematic diagram of the system structure of data management in a distributed cluster of the present invention, such as figure 1 As shown, the system includes: a master node 11 and a responsible node 12, wherein,

[0036] The master node 11 is used to partition the stored data, and select a slave node as the responsible node 12 for each data partition;

[0037] Specifically, the master node 11 partitions the stored data specifically partitions the stored data according to the number of slave nodes running in the current clus...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a system for managing data in a distributed cluster, which comprises a master node and responsible nodes, wherein the master node is used for partitioning stored data and selecting one slave node for each data partition as one responsible node; and each responsible node is used for managing the corresponding data partition under the charge. The invention also discloses a method for managing data in a distributed cluster. By using the system and the method, updates of different data partitions can be distributed on different slave nodes, thereby effectively sharing the load of the master node. Simultaneously, the responsible nodes can be assigned in accordance with practical situations of the slave nodes, thereby giving a full play to capabilities of the slave nodes.

Description

technical field [0001] The invention relates to computer cluster technology, in particular to a system and method for data management in a distributed cluster. Background technique [0002] Computer cluster, referred to as cluster, is a parallel or distributed processing system. The cluster is connected to each other through a group of loosely integrated computers, and highly closely cooperates to complete the required computing work. Among them, a single computer is usually called a node. An in-memory database system can be implemented through cluster technology, which includes a master node and multiple slave nodes. The master node is responsible for synchronizing data to each slave node and managing the slave nodes. Each node stores the same data, and each node can complete the same work. Since multiple nodes can process in parallel, the use of cluster technology can improve the data processing efficiency; on the other hand, the data of multiple nodes, the working proc...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04L12/24H04L29/08
Inventor 李浩胡杰文
Owner ZTE CORP
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap