Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Method and system for analyzing database incremental logs

An analysis method and data analysis technology, applied in database incremental log analysis method and system field, can solve problems such as metadata error, metadata loss, inconvenience, etc.

Inactive Publication Date: 2015-12-30
ALIBABA GRP HLDG LTD
View PDF4 Cites 28 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] 1. Affected by the second DDL operation, the metadata corresponding to the first DDL operation has an error
[0007] 2. When both DDL operations modify the metadata of the same table, the metadata generated by the first DDL operation will be overwritten on the database, and the metadata of this version will be lost.
[0008] In summary, there are obviously inconveniences and defects in the actual use of the existing technology, so it is necessary to improve

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and system for analyzing database incremental logs
  • Method and system for analyzing database incremental logs
  • Method and system for analyzing database incremental logs

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0024] In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

[0025] In a typical configuration of the present application, the terminal, the service network device and the trusted party all include one or more CPUs (Central Processing Unit, central processing unit), input / output interfaces, network interfaces and memory.

[0026] Memory may include non-permanent memory in computer-readable media, in the form of RAM (Random Access Memory) and / or non-volatile memory such as ROM (Read-Only Memory) or flashRAM (flash memory) . Memory is an example of computer readable media.

[0027] Computer-readable media, including both permanent and non-permanent, removabl...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

Provided are a method and system for analyzing database incremental logs. Under the conditions of executing dense DDL operations, the problem of metadata loss during mysqld can be reversely checked. The method comprises the steps that metadata and the database incremental logs are acquired from a source database, and the metadata are copied into a database analysis module; the DDL operations in the database incremental logs are inquired, and serially input into the database analysis module to be executed, and new metadata are generated according to the metadata acquired from the source database and execution of modification of the DDL operations on the metadata through the database analysis module; every time one DDL operation is finished being executed, the database analysis module is searched for the new metadata corresponding to the DDL operation, and the database incremental logs are analyzed according to the new metadata. The metadata accurately matched with the database incremental logs can be provided in the analysis process of the database incremental logs.

Description

technical field [0001] The invention relates to the technical field of data processing, in particular to a database incremental log analysis method and system. Background technique [0002] Binlog is a database incremental log. The database incremental log is composed of various database table operation events. The location of a database incremental log (for example, mysql-bin.000002, 15846289) corresponds to a database table operation event. Database table operation events include three types: insert operation, update operation and delete operation. Data recovery and data replication can be performed on the database through the database incremental log. [0003] In a database table, a column is a collection of data with the same data type. The main incremental data of the database is stored in the column event type. These data need to pass the information provided in the table mapping event (such as Table_map_event): column type, column The length, etc. can be correctly p...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F17/30
Inventor 刘杰
Owner ALIBABA GRP HLDG LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products