Binlog analysis method

An analysis method, ODB technology, applied in the computer field, can solve the problem of not supporting the modification of table structure and so on

Active Publication Date: 2017-10-24
搜易居(北京)网络技术有限公司
View PDF5 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] The existing technology only supports the unified synchronization of data and structure with the main database, does not support modifying the original tabl

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Binlog analysis method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0034] The following combination conforms to the present invention to be further described.

[0035] In the binlog analysis method of the present embodiment, SDB and ODB are deployed on the same machine, the database structure is initialized, the file configuration filters out the mysql system library, and the desensitized data field (including user name, phone number, address, user ID, User ID number, etc.), null values ​​and empty string fields are processed separately (NULL-N, EMPTY-E, OTHERS-O), data type conversion when data desensitization, and user identification is modified from long type to varchar type due to encryption. Remove the non-null constraint and index constraint, remove the primary key constraint, and migrate the primary key to ods_id. Do the same when automatically synchronizing data structures. Specify the binlog starting point. In order to speed up the query, the index correlation is automatically added on the basis of the changed table structure.

[...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a binlog analysis method. The method includes following steps: step 1, creating SDB and ODB to realize alternation and separation of structure and data; step 2, reading and executing configuration for a synchronous program; step 3, running the program, synchronizing data, and altering data; step 4, exiting the program, and recording a binlog file and binlog recording points. Aiming at ODS needs, automatic coupling of data structure with ODS structure, data chain stretching is realized during data synchronizing, and ODS basic data are constructed.

Description

technical field [0001] The invention belongs to the field of computers, and in particular relates to a binlog analysis method. Background technique [0002] The basic data requirements of the business analysis department for ODS (Operational Data Store): [0003] 1. Need to record data change history in real time [0004] 2. The data structure is coupled into the ODS data structure [0005] 3. Data synchronization requires chain stretching [0006] The existing technology only supports the unified synchronization of data and structure with the main database, and does not support the modification of the original table structure, and at the same time perform data chain stretching operations on the basis of the original synchronization, so it does not meet the above requirements. Contents of the invention [0007] The purpose of the present invention is to realize the automatic coupling of the data structure to the ODS structure change, the data chain stretching during the...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30
CPCG06F16/23G06F16/27
Inventor 尹参
Owner 搜易居(北京)网络技术有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap