Unlock instant, AI-driven research and patent intelligence for your innovation.

Resource allocation method, master device, slave device and distributed computing system

A distributed computing and resource allocation technology, applied in the field of distributed computing, can solve problems such as low efficiency, unsupported scheduler, resources that cannot meet user needs, etc., and achieve the effect of avoiding low efficiency

Active Publication Date: 2021-02-19
BEIJING QIHOO TECH CO LTD
View PDF8 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, many distributed computing systems do not support schedulers, and resource allocation methods often cannot meet user needs, which may lead to inefficiency and even errors

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Resource allocation method, master device, slave device and distributed computing system
  • Resource allocation method, master device, slave device and distributed computing system
  • Resource allocation method, master device, slave device and distributed computing system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0060] Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited by the embodiments set forth herein. Rather, these embodiments are provided for more thorough understanding of the present disclosure and to fully convey the scope of the present disclosure to those skilled in the art.

[0061] Taking the distributed computing system Storm as an example, it can support real-time processing of streaming computing, but it does not support resource scheduling using Yarn. The computing tasks submitted to Storm are called Topology, and Topology consists of Spout and Bolt. There are two components in Storm, Nimbus and Supervisor. There is only one Nimbus globally, which is responsible for sending the code of the task to ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

A resource allocation method, a master device, a slave device, and a distributed computing system. The method comprises: acquiring a total amount of available resources on each physical node of a distributed cluster (S110); setting a standard resource limit for each computing task (S120); issuing the total amount of available resources and the standard resource limit to a resource allocation slave device on the corresponding physical node (S130); acquiring current available resources on each physical node upon the receipt of a submitted computing task (S140); determining, according to a resource demand and / or the standard resource limit configured in the computing task submitted by the computing task and the current available resources on each physical node, a physical node having sufficient resources and capable of running the computing task (S150); and allocating the computing task to the physical node having sufficient resources so that the resource allocation slave device on the physical node having sufficient resources allocates resources for the computing task within the standard resource limit (S160). The problem of low efficiency resulting from multiple computing tasks scrambling for the same computing resources can be avoided.

Description

technical field [0001] The invention relates to the technical field of distributed computing, in particular to a resource allocation method, a master device, a slave device and a distributed computing system. Background technique [0002] Many distributed systems use schedulers to allocate and schedule computing resources. For example, Hadoop can use Yarn for resource scheduling. However, many distributed computing systems do not support schedulers, and resource allocation methods often cannot meet user needs, which may lead to inefficiency and even errors. Contents of the invention [0003] In view of the above problems, the present invention is proposed to provide a resource allocation method, a master device, a slave device and a distributed computing system that overcome the above problems or at least partially solve the above problems. [0004] According to one aspect of the present invention, a resource allocation method is provided, wherein the method is applied to...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F9/50
CPCG06F9/5083
Inventor 倪传蕾马庆祥张馨予陈茁
Owner BEIJING QIHOO TECH CO LTD