Task processing system for distributed computation and task processing method for distributed computation

A distributed computing and task processing technology, applied in the field of network communication, can solve problems such as processing efficiency of parallel processing architecture, and achieve the effect of improving processing efficiency and scheduling flexibility

Inactive Publication Date: 2012-10-31
HUAWEI TECH CO LTD
View PDF4 Cites 35 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] Embodiments of the present invention provide a task processing system and a task processing metho

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Task processing system for distributed computation and task processing method for distributed computation
  • Task processing system for distributed computation and task processing method for distributed computation
  • Task processing system for distributed computation and task processing method for distributed computation

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0014] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are some of the embodiments of the present invention, but not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.

[0015] figure 1 It is a block diagram of a distributed computing task processing system according to an embodiment of the present invention. figure 1 The task processing system 10 includes two layers of schedulers, that is, a first layer scheduler 11 and a second layer scheduler 12 .

[0016] The first-level scheduler 11 receives a request for executing a task, starts or selects a second-level scheduler 12 corresponding to the task, and forwards the r...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

Embodiments of the invention provide a task processing system for distributed computation and a task processing method for the distributed computation. The task processing system comprises a first level scheduler which is used for receiving requests of executing a task, starting or selecting a second level scheduler according to the task, and transmitting the requests to the second level scheduler; and the second level scheduler which is used for decomposing the task into a plurality of subtasks according to a logical relationship of the task when receiving the requests are transmitted by the first level scheduler. The embodiments of the invention employ a two-level scheduling frameworks, with the second level scheduler corresponding to the task and the first level scheduler starting or selecting the second level scheduler corresponding to the task, so that the task processing system and the task processing method can be used in different tasks, and processing efficiency and scheduling flexibility are improved.

Description

technical field [0001] Embodiments of the present invention relate to the field of network communication, and more specifically, to a distributed computing task processing system and a task processing method. Background technique [0002] Currently, with the development of the Internet, the need for fast processing of a large amount of information becomes urgent. Therefore, parallel processing of data becomes very important. The distributed computing environment provides an effective means of resource sharing and interoperability between different software and hardware platforms in the network environment, and has become a common architecture for parallel processing. At present, the well-known parallel processing system in the industry adopts the MapReduce architecture. MapReduce is a distributed computing software architecture that can support distributed processing of large amounts of data. This architecture originally originated from the two functions of map (mapping) ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F9/50
CPCG06F9/4881H04L12/56G06F9/46
Inventor 靳变变刘文宇严军
Owner HUAWEI TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products