Sample data acquisition method and device for enterprise data warehouse system

A sample data and data warehouse technology, applied in the direction of electrical digital data processing, special data processing applications, instruments, etc., can solve the problems of time-consuming, labor-intensive and low-efficiency in the sample data extraction process, and achieve the effect of convenient and fast acquisition and overcoming time-consuming and labor-intensive effects

Active Publication Date: 2011-05-25
INDUSTRIAL AND COMMERCIAL BANK OF CHINA
View PDF3 Cites 25 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0011] The main purpose of the embodiments of the present invention is to provide a sample data acquisition method and device for an enterprise-level data warehouse system, so as to solve the problems of time-consuming, laborious and inefficient extraction of sample data in an enterprise-level data warehouse system in the prior art

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Sample data acquisition method and device for enterprise data warehouse system
  • Sample data acquisition method and device for enterprise data warehouse system
  • Sample data acquisition method and device for enterprise data warehouse system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0051] An embodiment of the present invention provides a sample data acquisition device for an enterprise-level data warehouse system, such as figure 1 As stated, the device includes:

[0052] The logical model information parsing unit 101 is configured to parse the logical model information including model relation information of the enterprise-level data warehouse system to obtain model relation information;

[0053] The configuration information generation unit 102 is configured to generate sample data extraction configuration information according to the model association relationship information;

[0054] An extraction script generation unit 103, configured to generate a full extraction script according to sample data extraction configuration information and preset extraction parameters;

[0055] A dependency determining unit 104, configured to perform iterative operations on the full extraction script to determine the dependency of the full extraction script scheduling;...

Embodiment 2

[0139] An embodiment of the present invention provides a sample data acquisition method of an enterprise-level data warehouse system, such as Figure 21 As shown, the method includes:

[0140] Step 101, analyzing logical model information including model relationship information of the enterprise-level data warehouse system to obtain model relationship information;

[0141] Step 102, generating sample data extraction configuration information according to model association relationship information;

[0142] Step 103, generating a full extraction script according to the sample data extraction configuration information and preset extraction parameters;

[0143] Step 104, performing an iterative operation on the full extraction script to determine the dependencies of the full extraction script scheduling;

[0144] Step 105, generating a scheduling file based on a directed graph data structure according to the dependency relationship;

[0145] Step 106, schedule the full extrac...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a sample data acquisition method and a device for an enterprise data warehouse system, wherein the method comprises the following steps: analyzing information of a logic model including the information of association relationship of the model of the enterprise data warehouse system so as to acquire the information of the association relationship of the model; generating sample data extraction configuration information according to the information of the association relationship of the model; generating a full amount extraction script according to the sample data extraction configuration information and preset extraction parameters; performing iterative operation on the full amount extraction script so as to determine the dependency relationship of scheduling of the full amount extraction script; generating a scheduling file based on the structure of data of an oriented graph; and scheduling the full amount extraction script in parallel according to the scheduling file so as to acquire sample data. With the adoption of the method and the device, the sample data of the enterprise data warehouse system can be conveniently and quickly acquired.

Description

technical field [0001] The invention relates to the technical field of computer data warehouses, in particular to a sample data acquisition method and device for an enterprise-level data warehouse system. Background technique [0002] With the continuous increase of upstream applications of the enterprise-level data warehouse system and the continuous expansion of the data volume in the basic area, summary layer and market area, and because the data in the basic area of ​​the enterprise-level data warehouse system is stored according to normalized models and abstract themes Yes, the underlying models and data become increasingly complex and difficult to understand. And, due to data security considerations in the production environment and the extremely large amount of data in the enterprise-level data warehouse system itself, it is impossible to check, research and analyze the full amount of data in the production environment or development environment, but only Conduct res...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
Inventor 金雁峰邬敏炜黄兆斌马雯瑾
Owner INDUSTRIAL AND COMMERCIAL BANK OF CHINA
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap