Resource scheduling method and device, electronic device and storage medium

A resource scheduling and resource technology, applied in the computer field, can solve problems such as low performance of cluster resource scheduling

Active Publication Date: 2019-10-22
BEIJING DAJIA INTERNET INFORMATION TECH CO LTD
View PDF5 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, as the size of the cluster becomes larger, the scheduling function of yarn gradually becomes a bottleneck, resulting in lower resource scheduling performance of the entire cluster.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Resource scheduling method and device, electronic device and storage medium
  • Resource scheduling method and device, electronic device and storage medium
  • Resource scheduling method and device, electronic device and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0071] In order to enable ordinary persons in the art to better understand the technical solutions of the present disclosure, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the accompanying drawings.

[0072] It should be noted that the terms "first" and "second" in the specification and claims of the present disclosure and the above drawings are used to distinguish similar objects, but not necessarily used to describe a specific sequence or sequence. It is to be understood that the data so used are interchangeable under appropriate circumstances such that the embodiments of the disclosure described herein can be practiced in sequences other than those illustrated or described herein. The implementations described in the following exemplary examples do not represent all implementations consistent with the present disclosure. Rather, they are merely examples of apparatuses and methods consi...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a resource scheduling method and device, an electronic device and a storage medium. The method comprises: calculating the resource allocation amount of each queue according tothe idle resource amount of a distributed cluster, the current resource occupation amount of each queue in the distributed cluster and the basic configuration information of each queue, and the basicconfiguration information being used for ensuring that the idle resource amount is allocated to each queue in a balanced mode; and according to the resource allocation quantity of each queue, allocating the nodes in the distributed cluster node pool to each queue. Therefore, according to the embodiment of the invention, before nodes in a distributed cluster node pool are distributed to queues ina distributed cluster, the number of resources allocated to each queue in the distributed cluster is calculated in advance. It is ensured that the amount of resources allocated to each queue is relatively balanced, and then a batch of nodes are concurrently obtained from a node pool according to a calculation result to perform actual resource allocation on each queue, so that the resource scheduling performance of the whole cluster is improved.

Description

technical field [0001] The present disclosure relates to the field of computer technology, and in particular to a resource scheduling method, device, electronic equipment and storage medium. Background technique [0002] In recent years, with the development of Internet technology, more and more extensive data has been continuously generated. The distributed cluster based on Hadoop ecology provides strong support for the implementation of various big data applications. Hadoop is an open source distributed system framework that has a wide range of applications in the fields of distributed storage, distributed computing, and distributed scheduling. In related technologies, Hadoop 2.0 separates the scheduling function from JobTracker into a separate scheduling module yarn, and schedules resources in a distributed cluster through yarn. However, as the size of the cluster increases, the scheduling function of yarn gradually becomes a bottleneck, resulting in low resource schedul...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F9/48G06F9/50
CPCG06F9/4881G06F9/5038G06F9/5083
Inventor 房孝敬赵健博郭相锟侯宇婷苏国东钟颖群
Owner BEIJING DAJIA INTERNET INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap