Health self-checking method and system for each node of distributed storage cluster

A technology of distributed storage and self-inspection system, which is applied in the health self-inspection method and system field of each node of a distributed storage cluster, and can solve problems such as lack of operability and scalability, increased execution time, and processes that can only be queued. , achieve the optimal balance between resource consumption and execution speed, good operability and scalability, and avoid system overhead

Pending Publication Date: 2021-04-13
北京浪潮数据技术有限公司
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, when the number of nodes in the cluster reaches hundreds or thousands or even more, the original concurrent multi-process mode starts too many processes, which will cause serious occupancy of system resources, and the single CPU (central processing unit) of the system ) can only process one process task at a time, and processes with more than the number of CPUs can only be queued and processed according t

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Health self-checking method and system for each node of distributed storage cluster
  • Health self-checking method and system for each node of distributed storage cluster
  • Health self-checking method and system for each node of distributed storage cluster

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0048] The core of the present invention is to provide a health self-inspection method and system for each node of a distributed storage cluster, which controls the upper limit of the number of concurrent health self-inspection processes through the process pool, and reuses the recovered processes to continue to execute the remaining nodes The health self-check task avoids the system overhead caused by frequent creation and destruction of processes. Moreover, by setting the upper limit of concurrently executing processes in the process pool to the number of CPU cores of the main management node, the speed of obtaining node health self-test results is maximized, and the consumption of system resources is saved, so that the resource consumption of process health self-test and The execution speed has reached the optimal balance, and it has good operability and scalability under large-scale cluster nodes.

[0049]In order to make the purpose, technical solutions and advantages of ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a health self-checking method and system for each node of a distributed storage cluster, which are applied to a main management node in the cluster. According to the invention, the upper limit of the number of the processes concurrently executing health self-inspection is controlled in a process pool mode, meanwhile, the recycled processes are reused to continue to execute the health self-inspection tasks of the remaining nodes, and system expenditure caused by frequent creation and destruction of the processes is avoided. Moreover, by setting the upper limit of the concurrent execution process of the process pool as the number of CPU cores of the main management node, the consumption of system resources is reduced while the speed of obtaining a node health self-check result is maximized, so that the resource consumption and the execution speed of process health self-check are optimally balanced, and the invention has good operability and expansibility under large-scale cluster nodes.

Description

technical field [0001] The invention relates to the field of distributed storage, in particular to a health self-check method and system for each node of a distributed storage cluster. Background technique [0002] At present, the health self-check of each node in a distributed storage cluster is implemented in a concurrent multi-process manner. Specifically, corresponding processes are started one by one according to the number of nodes in the cluster to obtain the health status of each node in the cluster. That is to say, How many nodes there are in the cluster, how many processes will be started at the same time. However, when the number of nodes in the cluster reaches hundreds or thousands or even more, the original concurrent multi-process mode starts too many processes, which will cause serious occupancy of system resources, and the single CPU (central processing unit) of the system ) can only process one process task at a time, and processes with more than the number...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F1/3234G06F9/50G06F11/30H04L12/26
CPCG06F1/3234G06F9/5027G06F11/3006H04L43/0811
Inventor 朱文龙
Owner 北京浪潮数据技术有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products