Resource scheduling method, device and system and electronic equipment

A resource scheduling and resource technology, which is applied in the computer field, can solve the problems of cluster resource waste, cluster resources being difficult to meet needs, and slow capacity expansion, etc., to achieve the effect of flexible scheduling

Pending Publication Date: 2021-03-05
ALIBABA GRP HLDG LTD
View PDF0 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] However, this method has the following disadvantages: before running a distributed computing framework, users first need to plan resources, then build a cluster, and then run jobs; when there are fewer jobs running in a certain period of time, the resources of the entire cluster A lot of waste will be wasted; when the

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Resource scheduling method, device and system and electronic equipment
  • Resource scheduling method, device and system and electronic equipment
  • Resource scheduling method, device and system and electronic equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0072] image 3 The flow of the resource scheduling method provided by the embodiment of the present invention Figure 1 , including the following steps:

[0073] S310. Receive a job submitted by a user.

[0074] The user can first obtain the certificate for identity authentication from the cloud service provider, and then send the specified server to receive the job, such as figure 1 The Master in submits the job (the certificate obtained before is submitted at the same time as the job is submitted). Then, the Master uploads the job information and certificate information to the control. The management and control system determines the number and content of jobs to be processed based on the job information uploaded by users.

[0075] S320, for the job submitted by the user, apply for a resource from the public resource pool to create a computing resource corresponding to the job, so as to process the job in the computing resource.

[0076] E.g, figure 1 The management a...

Embodiment 2

[0086] Figure 4 The flow of the resource scheduling method provided by the embodiment of the present invention Figure II , the method in figure 1 On the basis of the method shown, the configuration and release of the network attributes of the computing container during the process of creating the computing container corresponding to the job will be described, including the following steps:

[0087] S410, providing multiple private networks, and assigning a private network to each user when the user submits a job.

[0088] This solution provides multiple private network VPCs in advance. When a user submits a job for the first time, or when the user submits a job and determines that there is no corresponding VPC, a VPC can be assigned to the user. Different users are assigned different VPCs at the same time. .

[0089] S420. Bind the created network attribute information of the computing container to the private network of the corresponding user.

[0090] After determining t...

Embodiment 3

[0112] Figure 7 The structure of the resource scheduling device provided by the embodiment of the present invention Figure 1 , the device can be used to perform image 3 Shown method step, it comprises:

[0113] Job receiving module 710, configured to receive jobs submitted by users;

[0114] A computing resource creation module 720, configured to apply for a resource from a public resource pool to create a computing resource corresponding to the job for the job submitted by the user, so as to process the job in the computing resource;

[0115] The computing resource release module 730 is configured to release the computing resource to the public resource pool after the jobs in the computing resource are processed.

[0116] Further, in Figure 7 The resource scheduling device shown may also include:

[0117] The query service providing module is used to store the state data generated in the process of processing the job on the specified storage server, and provide the u...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention provides a resource scheduling method, device and system and electronic equipment, and the method comprises the steps of receiving a job submitted by a user; for the job submitted by the user, applying for resources from a public resource pool to create computing resources corresponding to the job, so as to process the job in the computing resources; and after the job in the computing resource is processed, releasing the computing resource to the public resource pool. According to the scheme of the embodiment of the invention, the resources can be elastically applied and released according to the job granularity, so that reasonable scheduling of the resources is realized, and the situation of resource shortage or idleness is avoided.

Description

technical field [0001] The present application relates to the computer field, and in particular to a resource scheduling method, device, system and electronic equipment. Background technique [0002] At present, in terms of distributed computing, many enterprises will first purchase a batch of virtual machines from cloud resource providers as service resources, manually build resource scheduling frameworks such as yarn and mesos, and then run resources such as spark and hadoop on the resource scheduling framework and other distributed computing frameworks. [0003] However, this method has the following disadvantages: before running a distributed computing framework, users first need to plan resources, then build a cluster, and then run jobs; when there are fewer jobs running in a certain period of time, the resources of the entire cluster It will waste a lot; when there is a business peak, the cluster resources can hardly meet the needs, and the expansion will be very slow...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F9/50
CPCG06F9/5005G06F2209/5011
Inventor 李伟
Owner ALIBABA GRP HLDG LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap