Data increment extraction method based on trigger

An incremental extraction and trigger technology, applied in the field of data processing, can solve problems affecting business and other issues, and achieve the effect of high reusability and high performance

Inactive Publication Date: 2010-12-22
浙江协同数据系统有限公司
View PDF2 Cites 55 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] In order to overcome the deficiencies in the prior art, the present invention aims to provide a trigger-based data incremental extraction method, which accurately captur

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data increment extraction method based on trigger
  • Data increment extraction method based on trigger
  • Data increment extraction method based on trigger

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0021] The following takes the oracle database as an example to illustrate the entire expansion process (SqlServer or other databases are similar). In the detailed description, numerous specific details are given to ensure a thorough understanding of the embodiments of the invention, and it will be understood by those having basic general knowledge in the art that the embodiments of the invention can be practiced without these specific details. Additionally, well-known methods, procedures, and components have not been described in detail so as not to obscure the implementation of the present invention.

[0022] The first stage: the implementation of the extraction table

[0023] The following is a simple extraction table structure, which only contains 2 fields, of which ID is the primary key. It should be explained here that the extraction table must have a primary key using the trigger-based incremental extraction method. Conditions must be imposed on this in the program. . ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to the technical field of data processing, in particular to a data increment extraction method based on a trigger. The method accurately captures variable data in a business system according to certain frequency; meanwhile too big pressure is prevented from being acted on the business system so as to avoid affecting the existing business. Meanwhile, a user can extract incremental data generated in the current period from a resource system according to certain period in the mode of customizing a plan task, or real-time data synchronization capability can be realized in the mode of detecting variable data in real time, which is provided by the system. The invention has the beneficial effects that the invention provides a variable data capturing mechanism, i.e. the mechanism can ensure that new data and old data can be distinguished when the data resource data changes; and thus the invention extracts the data in an incremental mode and does not need to carry out total-amount amount extraction for keeping data synchronous.

Description

technical field [0001] The invention relates to the technical field of data processing, in particular to a trigger-based incremental data extraction method. Background technique [0002] Data warehouse ETL (Extract-Transformation-Load) includes data extraction, transformation, and loading, among which: ① Data extraction: extract the data required by the target data source system from the source data source system: ② Data conversion: convert the data obtained from the source data source According to business requirements, the data is converted into the form required by the target data source, and the wrong and inconsistent data are cleaned and processed; ③Data loading: load the converted data to the target data source. In the three links of ETL, data extraction directly faces various scattered and heterogeneous data sources. How to ensure stable and efficient extraction of correct data from these data sources is a key issue that needs to be considered in the process of ETL de...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30
Inventor 肖榕
Owner 浙江协同数据系统有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap