Unlock instant, AI-driven research and patent intelligence for your innovation.

Metadata cluster load balancing method and device, terminal and storage medium

A cluster load balancing and load balancing technology, applied in electrical components, transmission systems, etc., can solve problems such as general balancing effect and inability to obtain global load information, and achieve the effect of improving balancing effect, improving automatic adaptability, and simplifying use.

Pending Publication Date: 2022-04-12
SUZHOU LANGCHAO INTELLIGENT TECH CO LTD
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, in the process of the current dynamic load balancing method, each metadata service is independently balanced, and the global load information cannot be obtained, and the balancing effect is average.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Metadata cluster load balancing method and device, terminal and storage medium
  • Metadata cluster load balancing method and device, terminal and storage medium
  • Metadata cluster load balancing method and device, terminal and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0039] In the current dynamic load balancing method, each metadata service is independently balanced, the global load information cannot be obtained, and the balancing effect is general. This embodiment 1 provides a metadata cluster load balancing method. The load calculation considers the load of the MDS itself. Number of requests, message queue length, CPU load. The master metadata service (MDS0) periodically initiates a load collection request command, and other metadata services (MDS) send their own load status to all other metadata services after receiving the load request command from the master metadata service. After all metadata services collect the load conditions of all metadata services, calculate the average load value and decide whether to initiate a load balancing action.

[0040] Such as figure 1 Shown is a schematic flowchart of a metadata cluster load balancing method provided in Embodiment 1, which includes the following steps.

[0041] S101. The master me...

Embodiment 2

[0074] The second embodiment provides a metadata cluster load balancing device, which is used to implement the aforementioned metadata cluster load balancing method.

[0075] Such as image 3 Shown is a schematic structural block diagram of a metadata cluster load balancing device provided in the second embodiment, including the following functional modules.

[0076] Load collection request initiation module 101: the main metadata service initiates a load collection request.

[0077] The user selects a metadata service as the master metadata service, and the master metadata service periodically initiates load collection requests to other metadata services. Of course, the master metadata service itself also performs load calculation.

[0078] Load calculation and sending module 102: calculate the metadata heat value of the file directory, each metadata service calculates its own load according to the metadata heat value, and sends its own load information to other metadata ser...

Embodiment 3

[0099] Figure 4 A schematic structural diagram of a terminal device 400 provided by an embodiment of the present invention includes: a processor 410 , a memory 420 and a communication unit 430 . When the processor 410 is used to implement the metadata cluster load balancing program stored in the memory 420, the following steps are implemented:

[0100] S101. The master metadata service initiates a load collection request.

[0101] S102. Calculate the metadata heat value of the file directory, and each metadata service calculates its own load according to the metadata heat value, and sends its own load information to other metadata services.

[0102] S103. Each metadata service calculates an average load according to the loads of all metadata services, and judges whether to perform load balancing according to the difference between its own load and the average load.

[0103] A metadata cluster load balancing method provided by the present invention, each metadata service in ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to the field of metadata cluster load balancing, and particularly discloses a metadata cluster load balancing method and device, a terminal and a storage medium. A main metadata service initiates a load collection request; calculating a metadata popularity value of the file directory, calculating a self load by each metadata service according to the metadata popularity value, and sending self load information to each of the rest metadata services; and each metadata service calculates an average load according to all metadata service loads, and judges whether to carry out load balancing or not according to the difference between the own load and the average load. According to the invention, each metadata service in the cluster sends own load information to other metadata services, each metadata service finally forms global load information after calculation, each metadata service carries out load balancing based on the global load information, and the balancing effect is improved.

Description

technical field [0001] The invention relates to the field of metadata cluster load balancing, in particular to a metadata cluster load balancing method, device, terminal and storage medium. Background technique [0002] Metadata operations are usually located on the critical path, making the MDS (Metadata Service) cluster very important for overall performance. MDS also faces the challenge of scalability in the distributed file system. When the number of MDSs in the cluster continues to increase, metadata operations are A greater degree of interdependence is required, making the consistency and consistency management of MDS more difficult when expanding. How to ensure the overall performance of the cluster as the number of metadata services increases is a problem that needs to be solved. [0003] There are currently two ways to maximize the performance of metadata service clusters: static load balancing and dynamic load balancing. Static load balancing requires manual inter...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): H04L67/1008H04L67/561
Inventor 李旭东张在贵
Owner SUZHOU LANGCHAO INTELLIGENT TECH CO LTD