Unlock instant, AI-driven research and patent intelligence for your innovation.

Method and device for parallel computing

A technology of parallel processing and execution time, applied in the direction of machine execution devices, calculations, multi-programming devices, etc., can solve the problems of reduced task execution efficiency and waste of resources, so as to avoid the reduction of execution efficiency, avoid resource idleness and waste, and avoid Effects of long response times

Active Publication Date: 2014-09-10
EMC IP HLDG CO LLC
View PDF6 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Generally, in the parallel processing of jobs, the premature start of downstream tasks will lead to waste of resources, and the late start of downstream tasks will lead to a decrease in the execution efficiency of the entire task, both of which will be detrimental to the overall execution efficiency of the job Impact

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for parallel computing
  • Method and device for parallel computing
  • Method and device for parallel computing

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0016] The principle and spirit of the present invention will be described below with reference to several exemplary embodiments shown in the accompanying drawings. These embodiments are given only to enable those skilled in the art to better understand and implement the present invention, but not to limit the scope of the present invention in any way.

[0017] As will be understood from the following description, one of the core inventive ideas of the present invention is to determine the data dependencies between upstream tasks and downstream tasks of a job in a quantitative manner, specific to each specific parallelized job. Then use the data dependency to dynamically determine the starting timing of the downstream task. In this way, resource idling and waste caused by downstream tasks starting too early can be avoided, while overall job execution efficiency degradation and long response time caused by downstream tasks starting too late can be avoided.

[0018] first refer...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a method and a device for parallel computing. According to the embodiment of the invention, an operation parallel computing method is provided. Processing of the operation at least comprises executing an upstream task at a first stage and executing a downstream task at a second stage. The method comprises the following steps: quantitatively determining a data dependence relationship between the upstream task and downstream task; selecting the startup time of the downstream task at least partially based on the data dependence relationship. A corresponding device is further disclosed. According to the embodiment, the data dependence relationship among tasks at different stages can be determined accurately and quantitatively in order to select proper downstream task startup time.

Description

technical field [0001] Embodiments of the invention relate to methods and apparatus for parallel computing. Background technique [0002] Parallel computing has been widely used. According to this calculation mode, a job (job) can be divided into multiple task stages. The tasks of each stage can be distributed to multiple different nodes to be executed in parallel. Then, the data generated in the previous stage (called "intermediate data") is transferred to the tasks in the next stage for subsequent processing. There can be multiple tasks that can be executed concurrently in the same stage, and there are data dependencies between tasks in different stages. In parallel or distributed computing, an important consideration is the data dependency between different task stages. [0003] Take the MapReduce (mapping reduction) model, which is often used for parallel job processing, as an example. It divides a job into two stages: a map stage and a reduce stage. As known in the...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F9/38
CPCG06F9/52G06F9/4881G06F2209/484
Inventor 向东曹逾陶隽
Owner EMC IP HLDG CO LLC