Cluster resource scheduling method and system

Abstract

The invention provides a cluster resource scheduling method and system. The cluster resource scheduling system receives resource requests which are based on a preset resource policy and are sent by tenant administrator users; the cluster resource scheduling system allocates resource segments for tenants to which tenant administrators belong according to the resource requests; then the tenant administrator users send secondary allocation instructions to the cluster resource scheduling system, the cluster resource scheduling system allocates resources in the resource segments to the users underthe tenants according to the secondary allocation instructions so that the users can run predetermined tasks on the resources. According to the invention, the resources of each node of a cluster are divided into resource segments for allocation to the tenants through primary allocation, then the resources are allocated to the users through secondary allocation, and the users run the tasks by use of the allocated resources, such that the resource allocation efficiency is improved. In addition, during the primary allocation, the resources on the different nodes can be integrated in one resourcesegment so that the resource allocation is more flexible, and the utilization rate of the resources is improved.

Description

technical field [0001] The invention relates to the technical field of computer resource management, in particular to a cluster resource scheduling method and system. Background technique [0002] In the environment of modern application of big data, there are more and more enterprise data, and the scale of service users is increasing. The basic service equipment used by IT enterprises, such as computing and storage nodes (servers), is also growing geometrically. To manage large-scale cluster resources in these data centers, an effective, safe and efficient resource allocation and scheduling algorithm and an efficient, safe and effective management platform are required. Based on different purposes, cluster resource allocation and scheduling methods can be roughly summarized into the following categories: combination-based fair resource scheduling, priority-based scheduling, and multi-level resource scheduling based on determination mechanisms. In addition, there are resear...

AI Technical Summary

Problems solved by technology

In addition, there are researches on dynamic scheduling methods based on game theory, ant colony optimization algorithm, maximum threshold, etc., but they have not been implemented in industry yet.

[0003] However, the current cluster resource allocation usually has large-scale multi-tenant requirements, and different tenants cannot accurately estimate the resource requirements. For the cluster resource allocation in this scenario, the existing technology usually allocates resources directly according to the requests of each user in the tenant. Users, so that users can run tasks on the allocated resources, and as the number of tenants increases, the number of users who actually apply resources is also increasing. The existing cluster resource allocation method requires greater investment and cannot be quickly implemented. Completing cross-tenant resource migration scheduling increases the difficulty of resource scheduling, resource scheduling efficiency is low, and resource utilization is low

Images