Calculation task distribution method and apparatus

A computing task and computing node technology, applied in the computer field, can solve the problems of reducing the processing efficiency of computing tasks and the inability of computing nodes to be disposed of and utilized.

Inactive Publication Date: 2016-05-25
INSPUR GROUP CO LTD
View PDF9 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In this way, the computing nodes with high computing power in the Hadoop cluster cannot be processed and utilized, which reduces the processing efficiency of computing tasks in the Hadoop cluster

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Calculation task distribution method and apparatus
  • Calculation task distribution method and apparatus
  • Calculation task distribution method and apparatus

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0021] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.

[0022] An embodiment of the present invention provides a method for allocating computing tasks, which is applied to a cluster containing at least one computing node, such as figure 1 As shown, the above methods include:

[0023] Step 101. Obtain computing resources of computing nodes.

[0024] Wherein, the computing resource includes the number of cores of a CPU (Central Processing Unit) of the computing node and the size of free memory of the computing node.

[...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

Embodiments of the invention provide a calculation task distribution method and apparatus, which relate to the technical field of computers and are used for improving the processing efficiency of calculation tasks of a Hadoop cluster. The method comprises the steps of obtaining a calculation resource of a calculation node, wherein the calculation resource comprises a kernel number of a central processor unit (CPU) of the calculation node and the size of an idle memory of the calculation node; according to the kernel number of the CPU of the calculation node, determining the number m of the calculation tasks of the calculation node, wherein m is the number of the calculation tasks of the calculation node; according to the number m of the calculation tasks of the calculation node, determining a memory required for the m calculation tasks of the calculation node, and determining whether the idle memory of the calculation node meets the requirement of the memory required for the m calculation tasks of the calculation node or not; and when the idle memory of the calculation node meets the requirement of the memory required for the m calculation tasks of the calculation node, allocating the m calculation tasks to the calculation node.

Description

technical field [0001] The present invention relates to the field of computer technology, in particular to a method and device for allocating computing tasks. Background technique [0002] With the massive increase of data, a single computer can no longer store massive data. Therefore, distributed clusters have received extensive attention. In a distributed cluster, data can be distributed to multiple computers for storage and distributed computing can be implemented. Hadoop is the infrastructure of distributed systems. Users can develop distributed programs without knowing the underlying details of the distribution, and make full use of the capabilities of cheap computer clusters to perform high-speed calculations and storage of data. [0003] Hadoop cluster is a big data platform integrating distributed storage and distributed computing. In the prior art, the same computing task is assigned to each computing node in the Hadoop cluster. However, the computing power of ea...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F9/50
CPCG06F9/5027G06F9/5016G06F2209/503
Inventor 郭美思
Owner INSPUR GROUP CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap