Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Synchronization method, device and system for incremental data and electronic equipment

A technology of incremental data and data, applied in structured data retrieval, database distribution/replication, digital data information retrieval, etc., can solve the problem of low synchronization efficiency, achieve the effect of improving synchronization efficiency and reducing data volume

Pending Publication Date: 2019-07-16
ALIBABA CLOUD COMPUTING LTD
View PDF3 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] Embodiments of the present invention provide an incremental data synchronization method, device, system, and electronic equipment to solve the defect of low synchronization efficiency in the prior art when the amount of incremental data is large, and improve the synchronization efficiency of incremental data

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Synchronization method, device and system for incremental data and electronic equipment
  • Synchronization method, device and system for incremental data and electronic equipment
  • Synchronization method, device and system for incremental data and electronic equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0022] figure 1 The system block diagram of the incremental data synchronization system embodiment provided by the present invention. Such as figure 1 As shown, the incremental data synchronization system includes: a source database 1 , a destination database 2 and a client 3 . Wherein, the client 3 is used to synchronize the incremental data in the source database 1 to the destination database 2 . Client 3 obtains the incremental data of the source data table from the source database 1, preprocesses the incremental data of the source data table, and obtains valid incremental data, which is obtained from the latest update of the same row of data in the source data table. Generated by the row operation, the effective incremental data is synchronized to the destination data table of the destination database 2. The preprocessing operation of the client 3 on the incremental data can be specifically: adding an operation identifier to the incremental data, the operation identifie...

Embodiment 2

[0028] figure 2 The flow chart of an embodiment of the method for synchronizing incremental data provided by the present invention is executed by the client in the system described in the above embodiments. Such as figure 2 As shown, the incremental data synchronization method includes the following steps:

[0029] S201. Preprocess the incremental data in the source data table to obtain valid incremental data, which is generated by the latest row operation of the same row of data in the source data table.

[0030] In the embodiment of the present invention, the client obtains the incremental data of the source data table from the source database, and preprocesses the incremental data, and obtains the effective incremental data generated by the latest row operation of the same row of data in the source data table .

[0031] S202. Synchronize the valid incremental data.

[0032] After obtaining the valid incremental data, the client performs synchronous processing on the v...

Embodiment 3

[0035] image 3 It is a flow chart of another embodiment of the method for synchronizing incremental data provided by the present invention. Such as image 3 shown in the above figure 2 On the basis of the illustrated embodiment, the method for synchronizing incremental data provided by this embodiment may also include the following steps:

[0036] S301. Obtain an incremental log, and parse out incremental data of the source data table from the incremental log.

[0037] In the embodiment of the present invention, the client obtains the incremental log from the source database, and parses the incremental log to obtain the incremental data of the source data table in the source database.

[0038]S302. Add an operation identifier to the incremental data, the operation identifier uniquely corresponds to the row operations of the source data table, and gradually increases according to the chronological order of the row operations.

[0039] S303. For the incremental data of the...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the invention provides a synchronization method, device and system for incremental data and electronic equipment. The method comprises the steps that incremental data of a source data table are preprocessed, effective incremental data are obtained, and the effective incremental data are generated by latest line operation of the same line of data in the source data table; and synchronous processing is carried out on the effective increment data. According to the embodiment of the invention, the effective incremental data generated by the latest operation of the same row of data in the source data table is acquired, and only the effective incremental data is synchronized, so that the to-be-synchronized data size is greatly reduced, and the synchronization efficiency is improved.

Description

technical field [0001] The present invention relates to the field of communication technology, in particular to a method, device, system and electronic equipment for synchronizing incremental data. Background technique [0002] Database data synchronization is a common requirement that has always existed. Its typical application scenarios are, for example, synchronizing some tables in the transaction database to the analytical database for generating reports; or synchronizing some tables in the database of business A to the database of business B to support business B. [0003] At present, a mainstream data synchronization method is to obtain incremental data by parsing incremental logs, and then synchronize the incremental data to the target database. In this synchronization method, first, by parsing the incremental log, restoring the insert (insert), modifying (update), and deleting (delete) operations of the source data table to obtain incremental data, and then performi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F16/27
CPCG06F16/275
Inventor 曾文旌
Owner ALIBABA CLOUD COMPUTING LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com