Data processing method and device applied to databases as well as data storage system

Abstract

The invention discloses a data processing method and device applied to databases as well as a data storage system. The method comprises steps as follows: partition indexes in a distributed cache are inquired according to inquiry parameters in an inquiry request, and partitioning keys corresponding to the inquiry parameters are acquired; if no partitioning keys are acquired from the distributed cache, partition indexes in an index database are inquired according to the inquiry parameters, and the partitioning keys are acquired; databases are accessed according to the partitioning keys. With the adoption of the data processing method and device, performance bottlenecks and single-point risks caused by a single index database can be effectively avoided, and the high usability of the system is improved.

Description

technical field [0001] The present invention relates to the field of data processing, and more specifically, to a data processing method, device and data storage system applied to a database. Background technique [0002] The core of sub-database and sub-table lies in partition algorithm and partition index. For example, a consistent hash (hash) algorithm is used to partition a certain attribute of the data record (for example, the customer number), which can achieve as much balance as possible for the data records in each sub-database and sub-table. However, the sub-database and sub-table also bring limitations. Because it is a partition of a certain attribute of the data record (for example, customer number), when the query parameter is not the attribute (for example, customer number) but other attributes (for example, card number), it is impossible to obtain specific information based on the query parameter. The data is divided into databases and tables, so that the ent...

AI Technical Summary

Problems solved by technology

However, on the one hand, for the credit card business with such a large amount of data and high concurrent access, it is difficult for a single index library to support

On the other hand, in the sub-database and sub-table environment, since the uploaded query parameter is the card number or account number, the customer number must be obtained through the index library before subsequent data access operations can be performed. When a single index library goes down, the entire branch The business in the database sub-table environment will be affected, and there is a large single-point risk

Images