Parallel processing method for data, and server

Abstract

The invention discloses a parallel processing method for data, and a server. The method comprises the following steps that: loading first data into memory from a database, wherein the first data is latest data corresponding to a current first moment; when a detection result shows that data processing blockage is in the presence in the database, reading second data from the memory, wherein the second data is old data corresponding to a previous second moment; according to the second data, carrying out charging processing, obtaining to-be-submitted data which is to be submitted to the database,and putting the to-be-submitted data into a relief area; and according to the to-be-submitted data continuously read from the relief area, carrying out the asynchronous persistent processing of the database.

Description

technical field [0001] The invention relates to data processing technology, in particular to a data parallel processing method and server. Background technique [0002] In data processing, the simplest processing logic is usually executed sequentially. For example, there are three steps a, b, and c. The processing logic is to execute step a first, then step b, and finally step c. However, the processing logic of sequential execution seems simple, but there are various problems in practical applications. For example, in the reading and writing scenario, writing and reading are processed serially in order, which is inefficient. As another example, taking the billing business processing operation as an example, each time a billing task is processed, 1) data loading is performed first, for example, the balance data of the information recommender (such as an advertiser) and information related to information recommendation will be loaded from the database. Information such as bu...

AI Technical Summary

Problems solved by technology

[0003] It can be seen that the above operations are performed serially. The previous step in 1)-3) has not been executed, and the latter step cannot be performed. With the further development of the business, more and more data needs to be processed, which will lead to Data loading and database persistence operations are taking longer and longer

In addition, some data that needs to be processed is shared by the foreground and the background. If the front-end database has a large number of concurrent accesses, the read and write operations of the database will be blocked, which will affect the normal execution of the entire billing business process. Not only the processing efficiency Low, but also affect the accuracy of billing processing

However, in related technologies, there is no effective solution to this problem

Images