Dynamic sub-table data processing method and device

Abstract

The present invention discloses a method and device for processing data of dynamic sub-tables. The method includes: parsing the strategy of dynamic sub-tables to obtain configuration information of dynamic sub-tables; querying the database to obtain the number of empty data tables and data table instance information; In the cycle, check whether the number of current empty data tables is greater than or equal to the number of pre-segmented tables; if the number of empty data tables is less than the number of pre-segmented tables, create a data table according to the creation of table division strategies in the configuration information and Obtaining instance information of the new data table, so that the number of current empty data tables is greater than or equal to the number of pre-segmented tables; and updating the data table instance information of the data entity according to the new data table instance information. The device includes an analysis module, a data table instance information acquisition module, a check module, a dynamic data table creation module and an update module. The invention effectively controls the size of a single data table, reduces the IO pressure of the database, and improves system performance.

Description

technical field [0001] The invention relates to the technical field of databases, in particular to a method and device for processing dynamic sub-table data. Background technique [0002] In a large-scale business system that uses a relational database to store data, with the passage of time and business development, the data to be processed usually reaches tens of GB, and some business systems even reach the TB level. Although storage media and data processing technology are also developing, they still cannot meet the user's requirements for system performance. [0003] For such business systems, under the same hardware and software conditions (such as server clusters, solid state disks, database indexes, etc.), in order to further improve the database read and write performance, it is usually necessary to reduce the size of a single database table. On the premise that the logical design of the data table remains unchanged, this goal is usually achieved by reducing the num...

AI Technical Summary

Problems solved by technology

In addition, if there is too much production data at a certain moment, the performance improvement effect of this technology is not obvious

[0008] 2. In the process of business data processing, archiving logic needs to be added, so the code is more intrusive

If the filing logic is not added, regular manual filing is required, and unattended operation cannot be achieved, thus increasing the pressure of operation and maintenance

[0009] 3. The size of the historical data table will continue to increase, and additional business logic needs to be added to the processing of the historical data table

Another problem is: in order to achieve uniform distribution of data, different routing rules and calculation methods need to be formulated for different business data, resulting in the inability to decouple the splitting logic and business logic

Images