Data processing method and device

Abstract

The invention relates to the technical field of data processing in financial science and technology, in particular to a data processing method and device which are used for improving data processing performance and shortening time consumed for processing a large amount of data. The embodiment of the invention is applied to a service system. The service system comprises a database and at least twoservice nodes. The method comprises the following steps: the service nodes create N threads, and N is an integer greater than 1; for each thread of the service node, the thread searches for unmarked fragmentation information from all fragmentation information, and the fragmentation information is data information corresponding to fragmentation data obtained by fragmenting service data; wherein thethread locks one piece of unmarked fragment information and marks the fragment information; the thread obtains corresponding fragmentation data from the database according to the fragmentation information; and the thread processes the fragmented data and stores the processed fragmented data into the database.

Description

technical field [0001] The present invention relates to the technical field of data processing in financial technology (Fintech), and in particular, to a data processing method and device. Background technique [0002] With the continuous development of financial technology, especially Internet technology finance, more and more technologies (such as distributed, blockchain, artificial intelligence, etc.) are applied in the financial field, but the financial industry also puts forward higher requirements for technology. requirements, e.g. for data processing. [0003] Banks and financial systems process a large number of customer assets and liabilities in batches such as liquidation, interest calculation, and deduction every day. At present, most banks and financial systems still use a single database for data storage. There are complex pre-dependencies between batch transactions, and most batches are only allowed to be executed once. Therefore, batch transactions are often ...

AI Technical Summary

Problems solved by technology

[0004] In the existing technology, the concurrent processing capability of batch transactions is increased by increasing the number of threads, but there is always an upper limit to this e

Images