System and method for deploying large-scale cluster file system

Abstract

The invention provides a system and method for deploying a large-scale cluster file system. The method comprises the steps that a Json configuration file is generated by separating out configuration parameters needed in the cluster file system configuration procedure, the configuration file is analyzed through a shell script, and cluster deploying is quickly conducted; meanwhile, when a bottom-layer disk is processed, the disk with a large quantity of nodes is processed by adopting the strategy that the process and the thread are self-adaptively adjusted by a process pool and a thread pool, therefore, the disk processing speed of a large-scale cluster is optimized, and quick deployment of the large-scale cluster is achieved.

Description

technical field [0001] The invention relates to the field of cluster file systems, in particular to the rapid deployment of large-scale cluster file systems. Background technique [0002] Cluster (cluster) technology is a relatively new technology. Through cluster technology, relatively high benefits in terms of performance, reliability, and flexibility can be obtained at a lower cost. A cluster is a group of independent computers interconnected by a high-speed network that form a group and are managed as a single system. When a client interacts with the cluster, the cluster behaves like a stand-alone server. [0003] With the outbreak and popularization of big data, the Internet and even the Internet of Things, clusters have developed to large-scale and ultra-large-scale. figure 1 shows the traditional cluster deployment flow chart, figure 2 It shows the traditional cluster deployment disk processing flowchart. The cluster file system, especially the large-scale cluster...

AI Technical Summary

Problems solved by technology

figure 1 shows the traditional cluster deployment flow chart, figure 2 It shows the traditional cluster deployment disk processing flow chart. The cluster file system, especially the large-scale cluster file system deployment, is most criticized by enterprises for its cumbersome and time-consuming process. The most time-consuming step of cluster deployment is disk processing. The existing cluster deployment method Use manual sequential processing, first process the first disk of the first node, then process the second disk of the first node, and proceed in sequence until the disk on the first node is processed, and then process the second node, Then process the third node until all nodes are processed before performing other deployment operations; on the other hand, manual deployment setting a large number of parameters is prone to errors, resulting in deployment failure, and it is necessary to clear traces and redeploy

All of the above factors make the cluster deployment process cumbersome and time-consuming

Images