Method utilizing cache tables to improve insertion performance of data in database

Abstract

The invention relates to a method utilizing cache tables to improve insertion performance of data in a database, which includes firstly, building two database cache tables which are based on internal memory and have the same structure with a target data table to be inserted finally; secondly, inserting data into a first cache table, importing the data of the first cache table to the target data table after the data of the first cache table are higher than the maximum number threshold, inserting new data to a second cache table if the new data are required to be inserted to the database during the import process, and then importing data of the second cache table to the target data table after the data of the second cache table are higher than the maximum number threshold. By the method, the insertion performance of the data in the database can be improved greatly without updating of hardware or dead embracing of the database.

Description

technical field [0001] The invention relates to a method for improving database data insertion performance by utilizing a cache table. technical background [0002] Large-scale business application systems generally store system-related business data in a database. During the actual operation of the system, new business data of the same type are written into the data table corresponding to the database. The data of the data table is stored in the hard disk of the server. The writing performance of the hard disk affects the insertion performance of the data table. The current hard disk The read and write performance of the hard disk is the lowest part of the server components, and the read and write performance of the hard disk has become the bottleneck of the insertion performance of the database data table. In order to improve the insertion efficiency of the database, currently adopted technical solutions include: upgrading server hardware or batch insertion. [0003] By ...

AI Technical Summary

Problems solved by technology

[0003] By upgrading the server hardware (mainly the hard disk), the database insertion performance can be improved relatively simply, but the improvement range is limited, and the hardware overhead is relatively large, and the overall cost performance is not high

[0004] Batch insertion is a method of concatenating multiple pieces of data to be inserted into one statement and then submitting it to the database for execution at one time. It can achieve a large performance improvement without upgrading the hardware. When the table is read frequently, it is easy to cause the data table to be locked, which will cause frequent and periodic performance degradation, which is not conducive to the stability of the system.

Images