Resource scheduling method and device, electronic equipment and storage medium
A resource scheduling and resource technology, applied in the computer field, can solve the problem that the actual cluster resources are not fully utilized, and achieve the effect of effective utilization and reasonable allocation
Pending Publication Date: 2021-10-19
盛景智能科技嘉兴有限公司
View PDF0 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
[0003] At present, in a distributed system, its resource scheduling strategy is still based on defined rules to allocate physical nodes to the submitted tasks. In practical applications, with the increase in the amount of submitted model training tasks, more and more Training tasks are piled up while actual cluster resources are underutilized
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0060] The specific embodiments of the present invention will be further described below in conjunction with the accompanying drawings. The following examples are only used to illustrate the technical solution of the present invention more clearly, but not to limit the protection scope of the present invention.
[0061] The resource scheduling method provided by the embodiment of the present invention can be applied to such as figure 1 In the shown system architecture, the system architecture includes a resource scheduling model 100 and a server 200 .
[0062] Specifically, the resource scheduling model 100 is used to obtain the action description information of the deployment task after inputting the task and the current environment state;
[0063] Further, according to the action description information, the task is deployed to the server 200 corresponding to the action description information;
[0064] It should be noted that the trained resource scheduling model is obtaine...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention discloses a resource scheduling method and device, electronic equipment and a storage medium. The method comprises: obtaining a task and a current environment state; inputting the task and the current environment state into a trained resource scheduling model to obtain action description information of the deployment task; and deploying the task to a corresponding physical node according to the action description information, wherein the trained resource scheduling model is obtained by training different tasks and different environment states. According to the invention, by setting the action award based on the resource uniformity and the resource saturation, the uniformity of resource allocation and the resource saturation of a single node are considered, so that more tasks can be undertaken under the same hardware resource, thereby realizing reasonable allocation of submitted tasks and achieving effective utilization of cluster resources.
Description
technical field [0001] The present invention relates to the field of computer technology, in particular to a resource scheduling method, device, electronic equipment and storage medium. Background technique [0002] With the development and application of artificial intelligence technology, the requirements for computing power are becoming larger and larger. The current common practice is to build a distributed system cluster, and then do model training based on the cluster. For a cluster, the resource scheduling strategy is one of its core functions. [0003] At present, in a distributed system, its resource scheduling strategy is still based on defined rules to allocate physical nodes to the submitted tasks. In practical applications, with the increase in the amount of submitted model training tasks, more and more Training tasks are piled up while actual cluster resources are underutilized. [0004] To sum up, there is an urgent need for a resource scheduling technology ...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More IPC IPC(8): G06F9/50G06K9/62G06F9/48
CPCG06F9/5083G06F9/5038G06F9/4881G06F18/214
Inventor 陈杰唐振
Owner 盛景智能科技嘉兴有限公司