System, device and method for processing tasks in cloud computing platform

Abstract

The invention discloses a system, device and method for processing tasks in a cloud computing platform. The device for processing tasks in the cloud computing platform comprises a file information acquirer, a node information determiner and a task allocating unit, wherein the file information acquirer is configured to acquire information of all task data files from storage nodes storing the task data files, and the serial number of each task data file is determined on the basis of the information of the task data file; the node information determiner is configured to acquire information of task executing nodes, and the information of the task executing nodes comprises the number of the task executing nodes and the serial numbers of the task executing nodes; the task allocating unit is configured to evenly allocate the task data files to the corresponding task executing nodes to be processed according to the serial numbers of all the task data files and the information of the task executing nodes, and the task data files with adjacent serial numbers are allocated to different task executing nodes. According to the system, device and method for processing tasks in the cloud computing platform, the probability that a whole computing task is slowed because data processing amount of some task executing node is large can be reduced.

Description

technical field [0001] The invention relates to the field of cloud computing, in particular to the technical field of task processing in a cloud computing platform. Background technique [0002] Cloud Computing (Cloud Computing) is an Internet-based computing method and a kind of distributed computing technology. The basic principle of cloud computing technology is to use the network to automatically split the huge computing process into several smaller sub-processes, and then send the processing results back to a huge system composed of multiple servers after searching, computing and analyzing. The cloud computing system can handle a large amount of network computing in a short period of time, for example, it can process tens of millions or even billions of information in a few seconds, which makes cloud computing technology become another kind of information that can be processed in a short period of time besides supercomputers. Ways and means of processing large amounts ...

AI Technical Summary

Problems solved by technology

Because the amount of input data calculated on the cloud computing platform is often relatively large, and it often presents a certain degree of uneven data distribution, that is, some files have a very large amount of data, while other files have a relatively small amount of data, while The traditional task processing method often causes the calculation amount of each computing node to be uneven, which makes the calculation time of the node processing the task data file relatively long. However, to obtain the platform calculation results in the platform, it is often necessary to use the calculation results output by several processing nodes at the same time. However, task processing cannot be evenly distributed to each computing node that accepts computing tasks, which often slows down the processing speed of the entire task.

Images