Batch data processing method, front-end system, host and batch data processing system

Abstract

The invention provides a batch data processing method, a front-end system, a host and a batch data processing system. The method comprises the following steps: acquiring transaction data to be processed submitted by a user; sorting the transaction data to be processed according to a processing type of the transaction data to be processed, and extracting transaction data needing to be processed by the host; temporarily storing the transaction data needing to be processed by the host, and meanwhile generating an unprocessed transaction record of which a main key is a user transaction ID (Identity); de-queueing the temporarily-stored transaction data in a first-in first-out way, summarizing the de-queued transaction data and transmitting the summarized transaction data to the host in batches; and acquiring a transaction processing result generated by the host according to the transaction data, updating a state of a corresponding unprocessed transaction record according to the transaction processing result, and meanwhile feeding back the state of the corresponding unprocessed transaction record to the user. Through adoption of the batch data processing method, the front-end system, the host and the batch data processing system, the problem of system bottleneck caused by high transaction concurrence is solved; the network bandwidth pressure is lowered; the data processing efficiency is increased; the stability of the system in the case of data concurrence is improved; and the production security is ensured.

Description

technical field [0001] The invention relates to the technical field of computer data interaction, in particular to a batch data processing method, a front-end system, a host computer and a batch data processing system. Background technique [0002] With the rapid development of the Internet, the information systems of large enterprises are becoming more and more extensive, the interaction between different application systems is becoming more and more frequent, and the amount of concurrent data is increasing. The load balancing among various application systems has always been a concern of enterprises. . At the same time, the concentrated outbreak of transaction volume during certain periods may cause data transmission congestion between systems, which greatly affects production stability and customer experience. For example, when the stock exchange closes, there is a stock and fund trading peak, the railway ticketing system rushes to buy tickets during the Spring Festival ...

AI Technical Summary

Problems solved by technology

At the same time, the concentrated outbreak of transaction volume in certain periods may cause data transmission congestion between systems, which greatly affects production stability and customer experience

For example, when the stock exchange closes, there is a stock and fund buying and selling peak, the railway ticketing system rushes to buy tickets during the Spring Festival travel rush, Taobao. Data congestion, network delays, and data processing failures have caused certain economic losses to users, and have also had a relatively large negative impact on enterprises.

Images