A resource scheduling method and device

Abstract

The embodiment of the invention discloses a resource scheduling method and device. The method comprises the following step that: if other resource nodes allocated to a certain application already exist in a resource set when a resource scheduling device performs global resource allocation on the application, the resource scheduling device selects target resource nodes with smallest communication distances from the other resource nodes allocated to the application from idle resource nodes in order to allocate the target resource nodes to the application rather than randomly allocate resource nodes to the application. Through adoption of the resource scheduling method and device, communication distances among the resource nodes of the application can be minimized, namely, the communication loss is minimized; the communication efficiency among the resource nodes allocated to the same application is increased; the operation efficiency of the application is increased; and the analytical processing time of data in a whole system is shortened greatly.

Description

technical field [0001] The present invention relates to the field of information technology, in particular to a resource scheduling method and device. Background technique [0002] In the era of rapid development and popularization of information technology, data is growing explosively every year. The operating efficiency of big data analysis software has become one of the important criteria for the availability and ease of use of big data systems. How to give big data analysis software a A suitable operating environment to improve its operating efficiency has become a problem to be solved by big data systems, especially resource scheduling systems. [0003] In the current resource scheduling system, when the scheduler schedules a job of an application, if the job specifies a resource node, it will assign the specified resource node to the application; if a resource group is specified, it will assign the specified resource node Randomly assign a resource node to the applica...

AI Technical Summary

Problems solved by technology

[0004] In practice, it is found that due to the need for communication between resource nodes assigned to the same application, when global resource scheduling is performed, the communication distance between resource nodes assigned to the same application may be relatively large, which will reduce the resource node The communication efficiency between them will reduce the operating efficiency of the application program

Images