Load balancing method and device

A load balancing and data node technology, applied in the distributed field, can solve the problems of data loss and network traffic consumption, and achieve the effect of avoiding data loss, saving network traffic, and omitting I/O operations.

Active Publication Date: 2020-02-28
BEIJING XIAOMI MOBILE SOFTWARE CO LTD
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] In the process of data migration, a large number of I / O (Input / Output, input / output) operations will be involved, which will consume a lot of network traffic, and in addition, it is easy to cause data loss during the data migration process

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Load balancing method and device
  • Load balancing method and device
  • Load balancing method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0052] Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numerals in different drawings refer to the same or similar elements unless otherwise indicated. The implementations described in the following exemplary examples do not represent all implementations consistent with the present invention. Rather, they are merely examples of apparatuses and methods consistent with aspects of the invention as recited in the appended claims.

[0053] Before explaining the embodiment of the present disclosure in detail, a brief introduction to the architecture of the distributed file system involved in the embodiment of the present disclosure will be given first. see figure 1 , the architecture of the distributed file system includes a client (Client), a master node (MasterNode), a slave node (SlaveNode), a data node (DataNode) and a ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The present disclosure relates to a load balancing method and device, and belongs to the field of distributed technology. The method includes: obtaining the current disk usage of each data node in the distributed file system; assigning a random number of disk usage to each data node; for each data node, based on the current disk usage of the data node and the disk Use a random value to calculate the temporary disk usage of the data node; select a preset number of data nodes among all data nodes, and the temporary disk usage of the preset number of data nodes is smaller than that of other data nodes; The written file is written into the preset number of data nodes. This disclosure directly selects a data node with a relatively low load to write when writing data, and does not need to perform data migration for load balancing, omits I / O operations, saves network traffic, and avoids data loss during data migration , the load balancing effect is better.

Description

technical field [0001] The present disclosure relates to the field of distributed technologies, and in particular to a load balancing method and device. Background technique [0002] With the continuous development of Internet technology, the appearance of distributed file system has effectively solved the problem of data storage and management. Wherein, in the distributed file system, data is stored on each DataNode (data node). And the data storage capacity of each DataNode will continue to grow with the use of the distributed file system. In order to increase the storage capacity of the system, it is usually necessary to add a new DataNode to the distributed file system. The load of the newly added DataNodes will be much lower than the load of the existing DataNodes. At this time, load balancing needs to be considered to improve system performance. [0003] In related technologies, if load imbalance occurs between various DataNodes (data nodes), data storage balance amo...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): H04L29/08
CPCH04L67/1001
Inventor 郭军刘黎徐飞明
Owner BEIJING XIAOMI MOBILE SOFTWARE CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap