Method and system for realizing PostgreSQL incremental data synchronization

A technology of incremental data and implementation methods, applied in database management systems, database updates, structured data retrieval, etc., can solve problems such as not providing log analysis tools, achieve efficient transmission, and improve transmission efficiency

Pending Publication Date: 2021-01-26
SHANDONG LANGCHAO YUNTOU INFORMATION TECH CO LTD
View PDF5 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] At present, PostgreSQL realizes data synchronization with other types of databases, and there are not many implementation methods f

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and system for realizing PostgreSQL incremental data synchronization
  • Method and system for realizing PostgreSQL incremental data synchronization
  • Method and system for realizing PostgreSQL incremental data synchronization

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0028] In order to make the purposes, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments It is a part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative work are protected by the present invention. scope.

[0029] CMSP is a high-performance message middleware in the era of cloud and big data. It provides high-performance and high-reliability message queue services in the form of cloud services and clusters, and supports big data collection, transmission, aggregation, exchange, and real-time big data processing and processing. Microservice processin...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a method and a system for realizing PostgreSQL incremental data synchronization, and belongs to the technical field of data synchronization. According to the method, a WAL log generated by a production library is analyzed into an SQL corresponding to the operation, filtering can be carried out through a table name or a user name, incremental data is obtained, and the incremental data is efficiently sent to a target end in real time by means of the real-time performance of data transmission of a CMSP and converted into an operation SQL of a destination end database, and afunction of synchronizing incremental data of a PostgreSQL with other common types of databases is realized.

Description

technical field [0001] The invention relates to data synchronization technology, in particular to a method and system for realizing PostgreSQL incremental data synchronization based on WAL logs. Background technique [0002] PostgreSQL is an object-relational database management system (ORDBMS). It not only supports various functions of relational databases, but also has the characteristics of object databases such as classes and inheritance. It also provides writing and installation of user-defined plug-ins. It is currently the most functional The most powerful, feature-rich and structured open source database, some of which have feature sets that even commercial databases do not have. As PostgreSQL becomes more powerful and has more and more users, PostgreSQL has become one of the databases we need to focus on. [0003] The WAL mechanism was originally implemented in version 7.1 to alleviate the impact of data recovery due to server crashes. This mechanism is extremely im...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/25G06F16/23
CPCG06F16/252G06F16/258G06F16/23
Inventor 朱传举齐光鹏李朝铭方建勋
Owner SHANDONG LANGCHAO YUNTOU INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap