Database synchronization method, device and equipment and storage medium

A database and synchronization configuration technology, applied in the database field, can solve problems such as business database data synchronization failures

Active Publication Date: 2019-06-14
SUZHOU DAJIAYING INFORMATION TECH CO LTD
View PDF7 Cites 42 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The embodiment of the present invention provides a database synchronization method, device, equipment and storage medium to overcome the defects of the existing technology and solve the problem of data synchronization failure due to the special attribute of the business database field

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Database synchronization method, device and equipment and storage medium
  • Database synchronization method, device and equipment and storage medium
  • Database synchronization method, device and equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0027] figure 1 It is a flow chart of a database synchronization method provided by Embodiment 1 of the present invention, which is applicable to the situation of data warehouse ODS layer database synchronization, especially when there are special field attributes in the business database (for example, there are virtual keys, specific attributes, etc. in the business database) NOT NULL) is likely to cause data synchronization failure, the method can be executed by the database synchronization device provided by the embodiment of the present invention, the device can be implemented in software and / or hardware, and can generally be integrated into the processor of a computer.

[0028] Such as figure 1 As shown, the method of this embodiment specifically includes:

[0029] S110. Obtain table structure information of the source database and the target database.

[0030] In this embodiment, the synchronization of the database refers to synchronizing the data changes of the source...

Embodiment 2

[0079] figure 2 It is a flow chart of a database synchronization method provided by Embodiment 2 of the present invention. This embodiment is embodied on the basis of the above embodiments, wherein the updated data matching the table structure change information in the acquisition source database is synchronized to the Before the above target database, also include:

[0080] Update the data table synchronization configuration table according to the newly added table name of the newly added delete change information.

[0081] Further, the update data matching the table structure change information obtained in the source database is synchronized to the target database, specifically:

[0082] If it is determined that there are no new tables and new fields based on the newly added, deleted, and changed information, use the current ETL project to perform incremental data synchronization corresponding to the data table to be synchronized in the data table synchronization configura...

Embodiment 3

[0128] On the basis of the above embodiments, this embodiment provides a specific implementation mode for the specific application scenario of ODS database synchronization, taking synchronization of a business database to the ODS layer as an example, wherein, as Figure 3A As shown, the table structure synchronization part in the database synchronization method provided by this embodiment specifically includes:

[0129] S310. Create database connections with the service database and the ODS database respectively according to the connection association information in the pre-established database connection configuration table, and obtain table structure information of the service database and the ODS database.

[0130] S320. Determine, according to the table structure information of the business database and the table structure information of the ODS database, information about addition, deletion, and modification of data tables or fields associated with the table structure.

...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention discloses a database synchronization method and device, equipment and a storage medium. The method comprises the steps of obtaining table structure information of a source database and a target database; determining table structure change information according to the table structure information of the source database, the table structure information of the target database and a preset field attribute capture rule; generating a change statement according to the table structure change information, controlling the target database to execute the change statement soas to update the table structure information of the target database; obtaining update data matched with the table structure change information in the source database, and synchronizing the update datato the target database. According to the technical scheme provided by the embodiment of the invention, the defects of the scheme in the prior art are overcome, the synchronization function that multiple attributes of library table fields can be selected and contents can be filtered is realized, and the problem of data synchronization failure caused by special attributes of source database fieldsis solved.

Description

technical field [0001] The embodiments of the present invention relate to the technical field of databases, and in particular, to a database synchronization method, device, device, and storage medium. Background technique [0002] ODS (Operational Data Store, operational data storage) is used as an intermediate data layer between DW (Data Warehouse, data warehouse) and business systems, used to store data directly extracted from business systems, and needs to be synchronized with business data sources, specifically It is to synchronize with the table structure and data of the business database. [0003] In the prior art, it is generally to perceive the table structure change and data change of the business database by designing an external program, and then generate a SQL (Structured Query Language, Structured Query Language) statement by parsing the change information and make the target database execute the SQL statement, so as to To achieve the effect of database synchro...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/23G06F16/27G06F16/25
Inventor 赵志洲
Owner SUZHOU DAJIAYING INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products