Cluster capacity expansion method and device, electronic equipment and computer readable storage medium

Abstract

The invention provides a cluster capacity expansion method and device, electronic equipment and a computer readable storage medium, and relates to the field of cloud computing. The method comprises the following steps: acquiring cluster information of a preset big data cluster; and when determining that the big data cluster meets the capacity expansion condition based on the cluster information, sending a capacity expansion request to a preset container cloud cluster, so that the container cloud cluster generates a container corresponding to the capacity expansion request in response to the capacity expansion request. According to the method and the device, when the task event suddenly increases, the deployed big data cluster does not need to be artificially expanded, so that a large amount of labor cost is saved, automatic, dynamic, rapid and adaptive expansion is realized by reasonably using cloud resources, the capability of dealing with emergencies is greatly improved, and the user experience is improved. And meanwhile, cloud resources are not excessively consumed.

Description

technical field [0001] The present application relates to the technical field of cloud computing, and in particular, the present application relates to a cluster expansion method, device, electronic equipment, and computer-readable storage medium. Background technique [0002] In the prior art, big data applications with Hadoop (distributed system infrastructure) ecology as the core are usually deployed directly on physical machines or virtual machines, and through Yarn (Yet Another Resource Negotiator, another resource coordinator ) As a resource manager and scheduling engine, a node manager is deployed on each physical machine or virtual machine to manage the resources of a single node and maintain communication with the resource manager in the same node. [0003] However, Yarn in the prior art needs to be deployed in advance, and when a large number of unexpected services occur, it cannot meet a large number of business demands. At present, there is no mature solution in...

AI Technical Summary

Problems solved by technology

[0004] However, the above two schemes also have corresponding disadvantages: 1) If you choose scheme 1 for temporary expansion, in the face of a large number of sudden business, manual expansion is difficult to complete the expansion before the system performance reaches the bottleneck, which will seriously affect the availability of the system ;2) If you choose option 2 to expand capacity in advance, firstly, it will bring additional expenditure on resource utilization and cost, and secondly, based on experience to evaluate resource demand, it is often impossible to accurately prepare the required resources

If there is less preparation, temporary manual expansion is still required when business emerges, and the shortcomings mentioned in Solution 1 will also be encountered; if there is too much preparation, it will inevitably increase the waste of resources and costs

Images