Unlock instant, AI-driven research and patent intelligence for your innovation.

Incremental data acquisition method and device, incremental data sending method and device and computer storage medium

A technology of incremental data and acquisition method, applied in the database field, can solve the problems of difficulty in maintaining business data consistency, inability to distinguish the sequence of data changes, etc., to achieve the effect of improving consistency

Active Publication Date: 2020-11-13
TENCENT TECH (SHENZHEN) CO LTD
View PDF6 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, since the data in the database will change frequently in sub-database and sub-table and complex business scenarios, the sequence of data changes cannot be distinguished only through database logs, so it is difficult to maintain the final consistency of business data

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Incremental data acquisition method and device, incremental data sending method and device and computer storage medium
  • Incremental data acquisition method and device, incremental data sending method and device and computer storage medium
  • Incremental data acquisition method and device, incremental data sending method and device and computer storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0050] In order to make the purpose, technical solution and advantages of the present application clearer, the present application will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present application, not to limit the present application.

[0051] It should be noted that although the functional modules are divided in the schematic diagram of the device, and the logical sequence is shown in the flowchart, in some cases, it can be executed in a different order than the module division in the device or the flowchart in the flowchart. steps shown or described. The terms "first", "second" and the like in the specification and claims and the above drawings are used to distinguish similar objects, and not necessarily used to describe a specific sequence or sequence.

[0052] First, analyze some nouns involved in this application: ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses an incremental data acquisition method and device, an incremental data sending method and device and a computer storage medium. The method includes: acquiring position information of the update data in the database through the database update record table; determining first update data in the database and a first data table where the first update data is located; traversinga target data table in the directed acyclic graph from the first data table, obtaining first data associated with the first update data in each target data table, obtaining first incremental data according to the first update data and the first data. Since the change information of the data modified by the database each time is recorded in the database updating record table, and the target data table in the directed acyclic graph is related to the current service, so that the first incremental data related to the current service corresponding to the data update can be quickly obtained by positioning the first data table of the update data in the database and traversing the target data table in the directed acyclic graph, and the consistency of the service data is improved.

Description

technical field [0001] The invention relates to the technical field of databases, in particular to an incremental data acquisition method, a sending method, a device and a computer storage medium thereof. Background technique [0002] Incremental data capture (Change Data Capture, CDC) refers to the process of capturing the incremental data generated in the data source and providing it to other downstream businesses. CDC is one of the main problems to be solved in the process of data integration. CDC is used to capture data insertion, deletion, and update operations in business databases, and provides incremental data capture services for the synchronization of data in enterprise application databases such as OnLine Analytical Processing (OLAP) databases, reporting databases, data warehouses, and business intelligence databases. [0003] Distributed database synchronization systems such as DataBus can provide reliable data capture, transfer, and data processing functions. I...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F16/23G06F16/27G06F16/22
CPCG06F16/2282G06F16/2365G06F16/27
Inventor 郑杰孔庆峰易杰
Owner TENCENT TECH (SHENZHEN) CO LTD