Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Resource scheduling method, device, electronic device and storage medium

A resource scheduling and resource technology, applied in the computer field, can solve the problem of low cluster resource scheduling performance, and achieve the effect of improving resource scheduling performance

Active Publication Date: 2021-08-13
BEIJING DAJIA INTERNET INFORMATION TECH CO LTD
View PDF5 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, as the size of the cluster becomes larger, the scheduling function of yarn gradually becomes a bottleneck, resulting in lower resource scheduling performance of the entire cluster.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Resource scheduling method, device, electronic device and storage medium
  • Resource scheduling method, device, electronic device and storage medium
  • Resource scheduling method, device, electronic device and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0071] In order to enable ordinary persons in the art to better understand the technical solutions of the present disclosure, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the accompanying drawings.

[0072] It should be noted that the terms "first" and "second" in the specification and claims of the present disclosure and the above drawings are used to distinguish similar objects, but not necessarily used to describe a specific sequence or sequence. It is to be understood that the data so used are interchangeable under appropriate circumstances such that the embodiments of the disclosure described herein can be practiced in sequences other than those illustrated or described herein. The implementations described in the following exemplary examples do not represent all implementations consistent with the present disclosure. Rather, they are merely examples of apparatuses and methods consi...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The present disclosure relates to a resource scheduling method, device, electronic equipment, and storage medium. The method includes: according to the amount of idle resources of the distributed cluster, the current resource occupation of each queue in the distributed cluster, and the basic configuration information of each queue , calculating the resource allocation amount of each queue, wherein the basic configuration information is used to ensure that the idle resource amount is allocated to each queue in a balanced manner; according to the resource allocation amount of each queue, the distribution The nodes in the cluster node pool are allocated to the queues. It can be seen that in the embodiment of the present disclosure, before assigning the nodes in the distributed cluster node pool to each queue in the distributed cluster, pre-calculate how many resources are allocated to each queue in the distributed cluster to ensure that each queue is allocated The amount of resources is relatively balanced, and then according to the calculation results, a batch of nodes are obtained concurrently from the node pool to allocate actual resources for each queue, thereby improving the resource scheduling performance of the entire cluster.

Description

technical field [0001] The present disclosure relates to the field of computer technology, and in particular to a resource scheduling method, device, electronic equipment and storage medium. Background technique [0002] In recent years, with the development of Internet technology, more and more extensive data has been continuously generated. The distributed cluster based on Hadoop ecology provides strong support for the implementation of various big data applications. Hadoop is an open source distributed system framework that has a wide range of applications in the fields of distributed storage, distributed computing, and distributed scheduling. In related technologies, Hadoop 2.0 separates the scheduling function from JobTracker into a separate scheduling module yarn, and schedules resources in a distributed cluster through yarn. However, as the size of the cluster increases, the scheduling function of yarn gradually becomes a bottleneck, resulting in low resource schedul...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F9/48G06F9/50
CPCG06F9/4881G06F9/5038G06F9/5083
Inventor 房孝敬赵健博郭相锟侯宇婷苏国东钟颖群
Owner BEIJING DAJIA INTERNET INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com