Method for log mining based on physical level database

Abstract

The invention discloses a method for log mining based on a physical level database. The method comprises the following steps: (1) obtaining the size of a database system data block, an on-line log full path name and a log storage file system format; (2) obtaining current log group information from a database system view, and obtaining operating information; (3) mining log file header information, and obtaining current log series from a log file header; (4) mining a data block after the log file header, mining data of a fixed size each time and recording currently mined cut-off position indexes, and writing a data block content into a newly-built temporary file; (5) when an end mark of the file header is met, writing the end mark into a data block temporary file, ending current file mining, and staring next log file mining. According to the method, consistency and integrity of mined log information and a production library can be achieved fundamentally, and the performance influence on the production library caused by database log mining can be reduced.

Description

technical field [0001] The invention relates to a database log mining method based on a physical level, and belongs to the technical field of database data duplication. Background technique [0002] With the in-depth development of information technology and the continuous upgrading of application systems, data has gradually become a key part of information systems. However, all data processing contains a basic assumption - data availability and reliability. Database technology is currently the mainstream data processing technology in the fields of finance, electric power and telecommunications, and its data availability and reliability have naturally attracted much attention. Database log mining technology is produced under this requirement. [0003] There are two types of log mining technologies for relational databases at home and abroad, one is based on logical-level log mining technology, and the other is based on physical-level Redo mining technology. Database log m...

AI Technical Summary

Problems solved by technology

Database log mining technology is widely used in the field of information disaster recovery, mainly based on logical-level log mining technology, but in actual use, because the data mined based on logical-level database cannot support all database objects, resulting in Delivery of mined data to the disaster recovery database cannot guarantee the consistency of data objects

Traditional logic-level log mining is realized by extracting SQL from logs. It does not support the replication of all DDL operations, and does not support the replication of key database functions such as triggers and stored procedures. Often, disaster recovery databases are damaged due to changes in the database structure of the production database. Log mining is interrupted or even crashed, and the integrity of database log mining cannot be guaranteed

At present, the traditional physical-level Redo log mining technology cannot solve the problem of database log mining efficiency, and has a great impact on the production database.

Images