Data distribution method, server and computer readable storage medium

Abstract

The invention relates to a data processing technology, and discloses a data distribution method, which comprises the following steps of: starting a data processing task through a timing task scheduling platform; querying all mechanism information corresponding to the data processed by the data processing task; dividing the data processing task by mechanism according to the mechanism information togenerate a plurality of subtasks; sending the plurality of subtasks to a message queue, thereby distributing the subtasks to different clients for concurrent processing; and receiving and recording aprocessing result of each client for the plurality of subtasks. The invention further provides a server and a computer readable storage medium. According to the data distribution method, the server and the computer readable storage medium provided by the invention, the data processing tasks can be reasonably divided according to mechanisms and distributed to different clients for concurrent processing, so that the resource utilization rate and the processing efficiency are improved.

Description

technical field [0001] The present invention relates to the technical field of data processing, in particular to a data distribution method, a server and a computer-readable storage medium. Background technique [0002] Traditional databases such as oracle can calculate and process a large amount of data through stored procedures, but it will generate complex, redundant, and cumbersome codes, and it will be difficult to maintain in the later stage. Respond to business needs in a timely manner, and cannot achieve the goal of rapid iteration. Moreover, the database is a serial program, which cannot process a large amount of data concurrently, resulting in low resource utilization and time-consuming. In addition, the database service has been verified for decades and is superior in terms of data reliability and transactions, but the high cost makes it impossible for ordinary small and medium-sized enterprises to continue to use it. [0003] At present, the industry will use m...

AI Technical Summary

Problems solved by technology

[0002] Traditional databases such as oracle can calculate and process a large amount of data through stored procedures, but it will generate complex, redundant, and cumbersome codes, and it will be difficult to maintain in the later stage. Responding to business needs in a timely manner, unable to achieve the goal of rapid iteration

Moreover, the database is a serial program, which cannot process a large amount of data concurrently, resulting in low resource utilization and time-consuming

In addition, the database service has been verified for decades and is superior in terms of data reliability and transactions, but the high cost makes it impossible for ordinary small and medium-sized enterprises to continue to use it.

Images