Changed data extracting method realized by being based on Oracle CDC technique

A technology of data extraction and technology, applied in the direction of electrical digital data processing, special data processing applications, instruments, etc., can solve problems such as business system impact

Inactive Publication Date: 2010-02-10
山东中创软件商用中间件股份有限公司
View PDF0 Cites 10 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] 2. Performance, not to cause too much pressure on business databases and business tables, and not to affect the performance of existing business systems
The advantage of the trigger method is that the performance of data extraction is high, and the disadvantage is that it requires the business table to establish a trigger, which has a certain impact on the business system

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Changed data extracting method realized by being based on Oracle CDC technique
  • Changed data extracting method realized by being based on Oracle CDC technique

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0040] A change data extraction method based on Oracle CDC technology, specifically as follows:

[0041] As an existing technology, CDCSource directly faces users, provides a complete UI page, configures properties according to the prompts, and successfully deploys to the server after packaging. On the UI page, select the CDCSource component, and you can directly add information such as the configuration database address, user name, password, source table name, snapshot table name, destination table name, and the field list to be monitored and changed through the interface connection properties. easily achievable.

[0042] Such as figure 1 As shown, the method starts at step 101, where information in the xbean.xml file is parsed to obtain configuration information; these information include original table, snapshot table, destination table, fields and so on. It is used to build tables and send targets in subsequent programs.

[0043] Then go to step 102 to obtain the user h...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a changed data extracting device which is realized by being based on an Oracle CDC technique and comprises an analysis unit, a changed table establishment unit, a subscriptionuser establishment unit, a subscription view establishment unit, a data acquisition unit, a transmission and judgment unit and a subscription deleting unit. The invention can communicate with high performance without programming, thereby ensuring the information to be directly communicated in a path which is most effective and fast and is positioned between a source and an object.

Description

technical field [0001] The invention relates to a method for extracting changed data realized based on Oracle CDC technology. Background technique [0002] In the ETL process of building a data warehouse, the extraction of changed data is a very critical link. The solution to extracting changed data generally needs to meet the following two requirements: [0003] 1. Accuracy, the change data of the business table can be accurately retrieved into the data warehouse at a certain frequency. [0004] 2. Performance, not to cause too much pressure on the business database and business table, and not to affect the performance of the existing business system. [0005] Currently, the three most commonly used ways to achieve data synchronization are: [0006] 1. Timestamp synchronization [0007] Use a certain field in the business table as the basis for judging new and old data. This field can be of time type or int type. There are following problems in using this method: [00...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
Inventor 皮开元陈俊周刚舒琦
Owner 山东中创软件商用中间件股份有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products