Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Method and system for realizing PostgreSQL incremental data synchronization

A technology of incremental data and implementation methods, applied in database management systems, database updates, structured data retrieval, etc., can solve problems such as not providing log analysis tools, achieve efficient transmission, and improve transmission efficiency

Pending Publication Date: 2021-01-26
SHANDONG LANGCHAO YUNTOU INFORMATION TECH CO LTD
View PDF5 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] At present, PostgreSQL realizes data synchronization with other types of databases, and there are not many implementation methods for full and incremental collection. PostgreSQL does not provide a log analysis tool to analyze and generate corresponding redo and undoSQL

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and system for realizing PostgreSQL incremental data synchronization
  • Method and system for realizing PostgreSQL incremental data synchronization
  • Method and system for realizing PostgreSQL incremental data synchronization

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0028] In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments It is a part of the embodiments of the present invention, but not all of them. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative work belong to the protection of the present invention. scope.

[0029] CMSP is a high-performance messaging middleware in the era of cloud and big data. It provides high-performance and highly reliable message queue services in the form of cloud services and clusters, supports big data collection, transmission, aggregation, exchange, real-time processing of big data and Microservice processing architecture.

[0030...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a method and a system for realizing PostgreSQL incremental data synchronization, and belongs to the technical field of data synchronization. According to the method, a WAL log generated by a production library is analyzed into an SQL corresponding to the operation, filtering can be carried out through a table name or a user name, incremental data is obtained, and the incremental data is efficiently sent to a target end in real time by means of the real-time performance of data transmission of a CMSP and converted into an operation SQL of a destination end database, and afunction of synchronizing incremental data of a PostgreSQL with other common types of databases is realized.

Description

technical field [0001] The invention relates to data synchronization technology, in particular to a method and system for realizing PostgreSQL incremental data synchronization based on WAL logs. Background technique [0002] PostgreSQL is an object-relational database management system (ORDBMS). It not only supports various functions of relational databases, but also has the characteristics of object databases such as classes and inheritance. It also provides writing and installation of user-defined plug-ins. It is currently the most functional The most powerful, feature-rich and structured open source database, some of which have feature sets that even commercial databases do not have. As PostgreSQL becomes more powerful and has more and more users, PostgreSQL has become one of the databases we need to focus on. [0003] The WAL mechanism was originally implemented in version 7.1 to alleviate the impact of data recovery due to server crashes. This mechanism is extremely im...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F16/25G06F16/23
CPCG06F16/252G06F16/258G06F16/23
Inventor 朱传举齐光鹏李朝铭方建勋
Owner SHANDONG LANGCHAO YUNTOU INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com