A database processing method and system

Abstract

The invention discloses a database processing method and a system. The method comprises the following steps: S1, cleaning the new service data issued by the processing, and processing the new servicedata by semicolon section; S2, processing the new service data by semicolon section. S2, selecting new service data under one or more number segments, comparing the service data in the cached databasewith the selected new service data, and judging whether there is data inconsistent with the service data in the cached database in the selected new service data according to whether the data under the main change field is consistent; S3, if there is inconsistent data, marking the inconsistent data, and storing the inconsistent data in the cache database and the database. The invention adjusts theoverall structure and design of the service system, and realizes the pre-filtering of the service data through the comparison with the cached database when the database is updated, thereby alleviating the pressure of the massive data directly into the warehouse.

Description

technical field [0001] The invention relates to the field of computer technology, in particular to a database processing method and system. Background technique [0002] With the development of computer communication technology, the amount of data in the business system is getting larger and larger, and the problem of massive data backup for the business system is becoming more and more prominent, especially the database operation of backing up data to the production environment is a more difficult task. The problem. There are three types of database backup operations in the prior art: full backup, incremental backup, and differential backup. The so-called full backup refers to a complete copy of all data or applications at a certain point in time. Full backup is conducive to the rapid recovery of data, but since full backup will store a large amount of data in the database, there may be duplication data, so the backup time is longer. Incremental backup means that after a...

AI Technical Summary

Problems solved by technology

However, no matter which method is used above, the business data is collected and stored directly in the traditional relational database. For massive data, it takes a long time to enter the database, and the pressure on the IO and CPU of the database is very high. And there is a risk of locking the table

Especially in the production environment, the method of directly updating a large amount of data to the database is likely to cause the database to be paralyzed, thus affecting the operation of other applications in the system

Images