Data and compute-intensive processing system of cloud computing platform

Abstract

The invention discloses a data and compute-intensive processing system of a cloud computing platform. The data and compute-intensive processing system of the cloud computing platform comprises a computing work file generation module 1, a parallel computing control module 2, a file management module 3 and an error processing module 4. The computing work file generation module 1 processes data according to a work mode; the parallel computing control module 2 is used for distributing the computing resource of the system and controlling the work execution to enable the system to arrive at a minimum coupling; the file management module 3 is used for maintaining the input-output files of the work and temporary files generated by running; the error processing module 4 is used for guaranteeing the seamless running of the long-time running of the work and preventing the sudden stop of the running program. The data and compute-intensive processing system of the cloud computing platform is capable of meeting the data and compute-intensive processing needs, and meanwhile, the data and compute-intensive processing system of the cloud computing platform has good robustness and safety and strong engineering application value.

Description

technical field [0001] The invention relates to a data and calculation processing system, which belongs to the technical field of cloud computing, and in particular to a data and calculation-intensive processing system under a cloud computing platform. Background technique [0002] How to complete data-intensive and computing-intensive tasks at the lowest possible cost is one of the problems faced by many industries. For example, seismic data processing in oil exploration usually has the characteristics of large data volume, high computational complexity, and high computational efficiency requirements. . Supercomputers can undoubtedly provide effective solutions for this type of calculation, but the cost is too high, and the computing power of an ordinary single computer is not enough to complete this type of task. Assigning large-scale computing tasks to multiple computers in the network is one of the effective ways to complete data- and computing-intensive tasks. [0003...

AI Technical Summary

Problems solved by technology

[0004] At present, there are some defects in cloud computing data and computing processing systems. For public clouds, various large companies have been committed to in-depth development, but for private cloud systems, there are still relatively few in the market. At present, most cloud computing systems All are public cloud-oriented, but many existing data- and computing-intensive tasks often only use the hardware and system resources within the company or organization, and these resources are usually not accessible to ordinary Internet users

Images