Asynchronous data processing method and device and computer readable storage medium

Abstract

The embodiment of the invention provides an asynchronous data processing method, being characterized by storing to-be-processed data needing to be asynchronously processed by machines in a cluster in a preset database, wherein each piece of to-be-processed data is marked with a corresponding data identifier; when the target machines located in the cluster carry out asynchronous processing on the data, firstly determining the target machine identification of the target machines; and extracting multiple pieces of to-be-processed data with the data identification matching the target machine identification from the preset database, and finally conducting asynchronous processing on the multiple pieces of fished to-be-processed data. In the scheme of the asynchronous data processing method, due to the fact that the data identification is added to the to-be-processed data in the preset database in advance, the data source is processed and dispatched, thus guaranteeing that each machine in the cluster obtains the data matching the machine identification of the machine when obtaining the data, and guaranteeing that the data obtained by the machines in the cluster are different, and data conflicts cannot be generated.

Description

technical field [0001] The embodiments of this specification relate to the field of Internet technology, and in particular, to an asynchronous data processing method, device, and computer-readable storage medium. Background technique [0002] With the rapid development of the Internet, the continuous improvement and development of Internet business systems have been promoted, bringing great convenience to people's lives. When users handle related businesses on related Internet platforms, a lot of running data will be generated. These flow data will be fed back to the server of the platform. Usually, server clusters are used to process the flow data asynchronously. After the machines in the server cluster receive relevant data, they are stored on the platform, and then the machines in the cluster use an asynchronous method for subsequent processing. In the traditional processing mode, if each machine in the cluster obtains data equally, this method may cause different machi...

AI Technical Summary

Problems solved by technology

In the traditional processing mode, if each machine in the cluster obtains data equally, this method may cause different machines to obtain the same data, which increases data conflicts and additionally increases the burden on the database.

If the machines in the cluster use the time slice method, the execution of each machine is staggered, so that the computing resources cannot be well utilized

Images