Hotspot data batch scheduling method and device

Abstract

The batch scheduling method and device for hotspot data provided by the present invention first obtains a set of predetermined values ​​by performing modulo processing and mapping processing on the serial number, divides the set of predetermined values ​​into multiple batches, and then divides the set of predetermined values ​​into multiple batches, and then divides the set of predetermined values The transaction data corresponding to the predetermined value is sent to a data processing device for processing, so that one hot data is distributed to multiple data processing devices for processing, and the predetermined value is determined according to the number of virtual regions, so that the hot data can be processed according to the transaction serial number Evenly distributed, the partitions are no longer centralized, and online transaction insertion will not cause all records to compete for the same partition resource, and the partitions for every N transactions will be the same, which can effectively reduce online insertion hotspots and improve the success rate of transactions.

Description

technical field [0001] The present invention relates to the technical field of data processing, and more specifically, to a batch scheduling method and device for hotspot data. Background technique [0002] With the development of Internet finance, the business volume of third-party fast payment has shown explosive growth. For example, Tencent Tenpay’s “WeChat red envelope for the Spring Festival” activity, the highest business volume of fast payment through the transaction system of Industrial and Commercial Bank of China Limited in a single day has reached More than 50 million transactions, and the third-party payment business is often concentrated in a certain area, resulting in serious uneven data distribution, concentrated business hotspots, and slow batch processing efficiency of the host. These problems have become the bottleneck of the development of the third-party fast payment business, seriously affecting Cooperation between banks and third-party payment instituti...

AI Technical Summary

Problems solved by technology

[0002] With the development of Internet finance, the business volume of third-party quick payment has shown explosive growth. For example, Tencent Tenpay’s “WeChat red envelope for the Spring Festival” activity, the highest business volume of quick payment through the trading system of Industrial and Commercial Bank of China Limited in a single day has reached More than 50 million transactions, and the third-party payment business is often concentrated in a certain area, resulting in severely uneven data distribution, concentrated business hotspots, and slow batch processing efficiency of the host. These problems have become the bottleneck of the development of the third-party fast payment business, seriously affecting Cooperation between banks and third-party payment institutions

[0003] The outstanding problems of traditional data processing methods can no longer meet the needs of the development of third-party fast payment technology and application fields, and need to be solved urgently

Images