Unified processing method and tool for change data capture

A technology for changing data capture and processing methods, applied in the field of data capture, can solve the problems of large development and maintenance workload, different processing steps, and reduce development and maintenance workload, and achieve the effect of reducing development and maintenance workload.

Pending Publication Date: 2021-07-23
山东健康医疗大数据有限公司
View PDF9 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0013] In order to overcome the problem of large development and maintenance workload caused by various change data capture and processing methods and different processing steps in a multi-source heterogeneous

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Unified processing method and tool for change data capture
  • Unified processing method and tool for change data capture

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0065] Reference figure 1 This embodiment proposes a unified processing method of changing data capture, including the following steps:

[0066] S1, based on the data source type characteristics of the health care area platform, the agreement processing method, data with unique identifier, and stored in the destination database 8.

[0067] S2, according to each data set in each data set in the recorded destination database 8.

[0068] S3, the logo properties and data properties of each data collection in the destination database 8.

[0069] In this embodiment, it is assumed that the destination database 8 has a dataset DS, and the data set DS has n attributes, and the attribute is recorded as Attri [n], n> = 1, where:

[0070] Sign Properties: Attriid [1], Attriid [2] ... Attriid [i] Uniquely confirms a data in the data set, the attribute within this group records the flag attribute;

[0071] Data Attribute: Attridata [1], Attridata [2] ... Attridata [J] is all data, and the prope...

Embodiment 2

[0095] Reference figure 2 This embodiment proposes a unified processing tool for change data capture, including data acquisition module 1, recording module 2, marking module 3, defining module 4, comparison tag module 5, and saving module 6.

[0096] The data acquisition module 1 is configured to obtain data with unique identifier according to the data source characteristics of the health care area platform, and store data with unique identifiers and store it to the destination database 8.

[0097] The recording module 2 is used to record each data of each data set in the destination database 8.

[0098] The tag module 3 is used to mark the flag attribute and data properties for each data record of each data set in the destination database 8. In this embodiment, it is assumed that the destination database has a dataset DS, and the data set DS has n attributes, and the attribute is recorded as Attri [n], n> = 1, where:

[0099] Sign Properties: Attriid [1], Attriid [2] ... Attriid ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a unified processing method for change data capture, and relates to the technical field of data capture, and the method comprises the steps: based on the data source type characteristics of a health medical area platform, appointing a processing method, obtaining data with a unique identifier, and storing the data in a target database; recording each piece of data of each data set in the target database; performing attribute marking on each data record of the target database; defining a feature calculation function, and taking the mark attribute of the data as input to obtain a feature code; acquiring the data again, storing the data in the target database, capturing changed data based on the data identifier and the feature code comparison, and marking a piece of changed data; and storing the change mark of the data in the target database for a downstream data processing flow to use. The invention also discloses a unified processing tool for capturing the change data, which is combined with the method, performs unified processing on the acquired data, and reduces the workload of development and maintenance.

Description

Technical field [0001] The present invention relates to the field of data capture, and in particular, a unified processing method and tool for changing data capture. Background technique [0002] CDC (Change Data Capture), refers to the change of data. CDC can usually be divided into two types: (1) invasive: refers to the impact of the CDC operation gives the source system, as long as the CDC operation executes the SQL statement in any way, it can be considered invasive. CDC; (2) Non-invasive: no invasivity on the source system. There are four ways of CDC usually adopt: (1) Timestamp mode: requires the source system to have corresponding data columns to represent the final data change; (2) Snapshot mode: can be implemented using the mechanism of the database system, such as Oracle materialization View technology, you can also implement relevant logic yourself, but it will be more complicated; (3) Trigger mode: It is characteristic of the relational database system, and the trigge...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G16H10/60G06F16/22G06F16/21G06F9/54
CPCG16H10/60G06F16/211G06F16/2282G06F9/546G06F2209/548G06F2209/547
Inventor 张谦石兴磊
Owner 山东健康医疗大数据有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap