Data synchronization processing method and device, computer equipment and storage medium

A data synchronization and synchronous processing technology, applied in the field of data processing, can solve problems such as low support and not suitable for distributed databases, and achieve the effect of improving load capacity, ensuring data consistency, and ensuring eventual consistency

Pending Publication Date: 2022-03-25
SHANGHAI PUDONG DEVELOPMENT BANK
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] However, the master-slave replication method relies on the existing functions of the distributed database cluster, which is often used for synchronization between databases of the same type, and has low support for distributed storage systems such as HBase (distributed, column-oriented open source database); However, the method of synchronous message stream consumption requires secondary development, and can only be used for incremental data synchronization, and only supports synchronization of conventional operation types, such as insertion and deletion of a single piece of data, etc.
Therefore, the above quasi-real-time synchronization methods are not suitable for distributed databases, and there is an urgent need for a quasi-real-time data synchronization method suitable for distributed databases

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data synchronization processing method and device, computer equipment and storage medium
  • Data synchronization processing method and device, computer equipment and storage medium
  • Data synchronization processing method and device, computer equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0032] In order to make the purpose, technical solution and advantages of the present application clearer, the present application will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present application, and are not intended to limit the present application.

[0033] In one embodiment, such as figure 1 As shown, a data synchronization processing method is provided, and the method of this embodiment can be executed by the data synchronization processing device provided in the embodiment of the present application, and the device can be implemented by software and / or hardware. Specifically, the data synchronization processing method includes the following steps:

[0034] Step 102, receiving operation information on the distributed database.

[0035] Wherein, the operation information refers to the operation behavior information ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a data synchronization processing method and device, computer equipment, a storage medium and a computer program product. According to the method, operation information of a distributed database is received, a mirror database is synchronously processed according to the operation information, and then a confirmation response message of the operation information is returned. The final consistency of the data can be ensured through a confirmation response message mechanism. And the operation information for synchronous processing comprises at least one of the first operation on the data in the distributed database and the second operation on the table in the distributed database, so that the data consistency of the distributed database and the real-time synchronous mirror image database can be comprehensively guaranteed. In addition, according to the embodiment, the mirror image database is realized based on the distributed file system, so that the load capacity of data writing and data query can be improved.

Description

technical field [0001] The present application relates to the technical field of data processing, in particular to a data synchronization processing method, device, computer equipment, storage medium and computer program product. Background technique [0002] With the continuous development of financial informatization, financial data has shown explosive growth, and traditional data storage and data processing methods have been unable to meet the growing business needs. At this stage, distributed databases are widely used in data storage, but the data in distributed databases is scattered, which leads to low efficiency of data cross-database query, difficulties in generating reports and supplying data to third-party systems. Therefore, how to synchronize the data of sub-databases and sub-tables in a distributed database to a single database and a single table, and how to ensure the efficiency of synchronization has become a hot research topic in the industry. [0003] In tr...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/27G06Q40/00
CPCG06F16/275G06Q40/00
Inventor 白萌古毅伟吴德柱
Owner SHANGHAI PUDONG DEVELOPMENT BANK
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap