Data concurrent processing method, device and system, computer equipment and readable medium

Abstract

The invention provides a data concurrent processing method, device and system, computer equipment and a readable medium. The method includes: setting the parameter of the atomic type corresponding to the target event to be transmitted, and initializing it as 0; establishing a data queue, storing the relevant information of N data included in the target event, and carrying the address information of the atomic type parameter in the relevant information of each data According to the relevant information of N data in the data queue, multiple data sending devices send corresponding N data to the remote server in parallel, and each data sending device sends a data according to the address information of the atomic type parameter Accumulate 1; monitor whether the value of the atomic type parameter is equal to N; if so, determine that all data in the target event has been sent. The technical solution of the present invention can effectively improve the concurrent processing efficiency of data, shorten the duration of data transmission, and meet the requirements of scenarios with relatively high real-time requirements.

Description

【Technical field】 [0001] The present invention relates to the field of computer application technology, in particular to a data concurrent processing method, device and system, computer equipment and a readable medium. 【Background technique】 [0002] Data concurrent processing and sending technology refers to the technology of processing multiple data in a concurrent manner, and then sending the processed data to other services. [0003] In existing Internet technologies, some data needs to be processed through some steps before being sent to other services. Another characteristic of this type of data is that only when the receiving end receives all the processed data can it form a meaningful data unit for its own use. For example, a json data packet containing a list of picture names, it is useless to only send this data packet to the other party, because what the other party gets is only a list of picture names. In this case, only by passing the picture corresponding to ...

AI Technical Summary

Problems solved by technology

Moreover, the existing technical solution has simple logic and is relatively easy to implement

[0004] However, when the above technical solution is implemented, all tasks need to be processed sequentially in one process or thread, and the data transmission time will be longer, which cannot meet the needs of scenarios with high real-time requirements.

Images