Method and device for data balancing

A balancing method and data technology, applied in the field of data processing, can solve problems such as data imbalance, achieve the effect of controlling the scope and times, and reducing processing overhead

Active Publication Date: 2018-01-09
HUAWEI TECH CO LTD
View PDF5 Cites 15 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

It can solve the problem of data imbalance of each physica

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for data balancing
  • Method and device for data balancing
  • Method and device for data balancing

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0061] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts all belong to the protection scope of the present invention.

[0062] see figure 1 , is a schematic structural diagram of a distributed database system based on hash consistency provided by an embodiment of the present invention. In an embodiment of the present invention, the distributed database system includes at least one client, a metadata server, a data node server, and a storage network. At least one client communicates with the metadata server and the data node server respectively through the IP network, wherei...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention discloses a method for data balancing. The method comprises the steps that a load degree and n weight values of n weight factors of each virtual node on m physical nodes in a distributed database system are acquired, wherein m and n are integers which are larger than 1; according to the load degree and the n weight values of the n weight factors, weight averaging isconducted, so a weight coefficient of each virtual node is obtained; according to the weight coefficients of the virtual nodes correlated with each physical node, a standard zoning number is obtained; whether data distribution satisfies data balancing conditions is judged according to the standard zoning number corresponding to each of the m physical nodes; and if the conditions cannot be satisfied, data balancing processing can be conducted to the m physical nodes. The embodiment of the invention also discloses a data balancing device. By the method and device disclosed by the invention, thedata balancing of the physical nodes in the distributed database system can be conducted, and resource configuration can be optimized.

Description

technical field [0001] The invention relates to the field of data processing, in particular to a data equalization method and device for a hash consistent distributed database system. Background technique [0002] At present, distributed database technology is a distributed technology commonly used in the field of IT technology, which is mainly used in web page cache, database cache, etc. to meet the user's requirements for network system response speed. [0003] In a distributed database system based on a consistent hash algorithm, physical nodes can virtualize multiple virtual nodes, and then map multiple virtual nodes to the ring through the hash algorithm, so that the physical nodes can increase the number of nodes mapped on the ring. hash range. When adding new physical nodes or deleting physical nodes in the distributed database system, by adjusting the number of virtual nodes associated with each physical node, the number of virtual nodes associated with each physica...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F9/50G06F17/30
CPCG06F9/50G06F9/5077G06F9/5088G06F2209/5017
Inventor 陆敬石陶维忠吴刚
Owner HUAWEI TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap