Distributed parallel computing method, device and system

Abstract

The invention discloses a distributed parallel computing method, a distributed parallel computing device and a distributed parallel computing system. The distributed parallel computing method comprises the following steps that step request messages sent by more than two step processors are received, the step request messages are used for requesting execution steps to be processed in a task to be processed, and the step request messages comprise step processing types of the step processors; if the execution steps corresponding to the step processing types are dependent on processed execution steps in the task to be processed, step response messages are sent to the step processors; step processing results of the execution steps to be processed, which are sent by the step processors, are received, and the step processing results comprise a unique identification of the execution steps to be processed; and a task processing result of the task to be processed is generated in accordance with the step processing results. According to the distributed parallel computing method, the distributed parallel computing device and the distributed parallel computing system which are provided by the invention, the task processing efficiency can be increased, and computing resources can be reasonably distributed.

Description

technical field [0001] The invention relates to the field of distributed computing, in particular to a distributed parallel computing method, device and system. Background technique [0002] With the explosive growth of information volume and the increasing complexity of tasks, the processing of complex tasks cannot be solved simply by improving server performance. Usually, a complex task will include multiple execution steps, and a variety of computing resources, such as central processing unit (CPU), memory, network input / output system and hard disk input / output system, etc., are applied during task processing. For the problem of limited server processing capacity, the parallel computing technology generally used at present is to statically or dynamically assign tasks to be processed to task processors for processing. If there are multiple complex tasks, the usual practice is to assign multiple processes or threads to handle these tasks. We define the process or thread th...

AI Technical Summary

Problems solved by technology

[0005] The existing parallel computing technology is to statically or dynamically assign the tasks to be processed to the task processor for processing, the task processing efficiency is low, and the computing resources cannot be allocated reasonably

Images