Priority-based two-way synchronization method and priority-based two-way synchronization system

A technology of priority and synchronization operation, applied in the direction of program synchronization, file system, file system type, etc., can solve problems such as slowing down the speed of synchronization and affecting the performance of real-time synchronization system.

Active Publication Date: 2021-03-26
WUHAN DAMENG DATABASE
View PDF5 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

On a system that conducts a large amount of statistical analysis on database data, on the one hand, the operation of a large number of temporary tables, intermediate tables, or intermediate data affects the performance of the real-time data synchronization system, especially for temporary tables and intermediate tables that do not have a primary key / unique index. Batch operations seriously slow down the speed of synchronization. On the other hand, this kind of data operation is useless for the destination database. The data synchronization results of a certain period of data synchronization have no impact on the actual data of the destination database.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Priority-based two-way synchronization method and priority-based two-way synchronization system
  • Priority-based two-way synchronization method and priority-based two-way synchronization system
  • Priority-based two-way synchronization method and priority-based two-way synchronization system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0045]In an actual application scenario, deploy a source-end data synchronization system on the source-end database, deploy a destination-end data synchronization system on the destination-end database, and set a first task queue, a second task queue, and a first execution thread and a plurality of second execution threads, wherein the first task queue is used to store operations with a first priority, the second task queue is used to store operations with a second priority, and the first execution thread uses For processing operations of a first priority, the second execution thread is used for processing operations of a second priority, wherein the first priority is higher than the second priority.

[0046] Based on the aforementioned synchronization environment, this embodiment provides a priority-based two-way synchronization method, see figure 1 , the two-way synchronization method includes the steps of:

[0047] Step 101: Obtain the operation to be synchronized from the...

Embodiment 2

[0072] In this embodiment, the synchronization process of the second execution thread is described based on the foregoing embodiment 1:

[0073] In the actual application scenario, submitting the transaction table is used to register transaction information, mainly to prevent data synchronization failures (synchronization program exceptions, database service exceptions, operating system exceptions, or hardware failures) from inconsistency after recovery, for example, When the synchronization service finishes committing the transaction on the destination database, the commit command is successfully sent to the database service but the synchronization service has not received the execution result returned by the database service, and the synchronization service crashes abnormally. Since the synchronization service and the database are two independent entities, Although the synchronization service is abnormal, the database may still successfully submit the submission command sent ...

Embodiment 3

[0092] see Figure 4 , Figure 4 It is a schematic structural diagram of a synchronization system provided by an embodiment of the present invention. The synchronization system in this embodiment includes one or more processors 41 and a memory 42 . in, Figure 4 A processor 41 is taken as an example.

[0093] Processor 41 and memory 42 can be connected by bus or other means, Figure 4 Take connection via bus as an example.

[0094] The memory 42, as a non-volatile computer-readable storage medium based on a two-way synchronization method, can be used to store non-volatile software programs, non-volatile computer-executable programs and modules, the methods of the above-mentioned embodiments and the corresponding Program instructions. The processor 41 executes various functional applications and data processing by running non-volatile software programs, instructions and modules stored in the memory 42 to implement the methods of the foregoing embodiments.

[0095] Wherei...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a priority-based two-way synchronization method and synchronization system, and the method comprises the steps: obtaining a to-be-synchronized operation from a source end, andenabling the to-be-synchronized operation to belong to a first task queue or a second task queue according to the operation type of the to-be-synchronized operation; enabling the first execution thread to obtain a first target operation from the first task queue, analyze the first target operation to obtain an operation object involved in the first target operation, and update a version number ofan object file of the operation object based on a log serial number of the first target operation; enabling the second execution thread to obtain a second target operation from the second task queue and analyze the second target operation to obtain an object identification number ID1 of the second target operation and a log sequence number SCN1 of the second target operation; and obtaining the version number of the target object file based on the object identification number ID1, and performing selective synchronization according to the size relationship between the log sequence number SCN1 and the version number of the target object file.

Description

technical field [0001] The invention belongs to the technical field of data synchronization, and more specifically relates to a priority-based two-way synchronization method and a synchronization system. Background technique [0002] Synchronization performance is a key index in real-time synchronization system of database data. In reality, the upper-level application of the database often generates (create table / insert) some intermediate tables or intermediate data to store intermediate result sets or process certain data. After these tables or data are used, they will be used by the upper-level application Delete (drop table) or clean up (truncate table). [0003] At present, the database synchronization software takes the operation transaction of the source database as the unit and strictly follows the execution sequence of the source database to synchronize all data operations of the source database to the destination database. On a system that conducts a large amount ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/178G06F16/18G06F16/27G06F9/52
CPCG06F16/178G06F16/1873G06F16/27G06F9/52
Inventor 付铨刘启春余院兰孙峰
Owner WUHAN DAMENG DATABASE
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap