A data processing method and system for a data warehouse

A data processing system and data warehouse technology, applied in the field of data warehouse data processing methods and systems, can solve the problems of relying on a few tasks, the data processing efficiency of the data warehouse is not high, and the computer resources cannot be effectively used, etc., to avoid tasks. Interdependence, the effect of improving efficiency

Active Publication Date: 2018-12-28
ADVANCED NEW TECH CO LTD
View PDF7 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In this way, multiple tasks may depend on a few tasks, so in a certain period of time, only the few tasks may be executing in the general dimension model layer, and the multiple tasks of the downstream nodes are all waiting for the A few tasks are completed, so the computer resources in the distributed system environment cannot be effectively used, and the data processing efficiency of the data warehouse is not high

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A data processing method and system for a data warehouse
  • A data processing method and system for a data warehouse
  • A data processing method and system for a data warehouse

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0066] In order to enable those skilled in the art to better understand the technical solutions in this application, the following will clearly and completely describe the technical solutions in the embodiments of this application with reference to the drawings in the embodiments of this application. Obviously, the described The embodiments are only a part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in this application, all other embodiments obtained by those of ordinary skill in the art without creative work should fall within the protection scope of the present invention.

[0067] The following describes the first embodiment of the data processing system of the data warehouse of this application. figure 1 It is the composition structure diagram of the embodiment of the data warehouse data processing system of this application. Such as figure 1 As shown, the data processing system of the data warehouse of this applicat...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a data processing method for a data warehouse, which comprises: extracting original data from service systems and generating source system data tables; eliminating redundancy of the source system data tables, recording data histories and establishing historical data tables; establishing fact data tables to classify the data of the historical data tables; summarizing data of the fact data tables and establishing summarized data tables; counting index data among two or more summarized data tables, and establishing a statistic data table; based on the data of the fact data tables, the summarized data tables and the statistic data table, establishing an application data table. According to the data processing method for the data warehouse, which is provided by the invention, mutual dependency of tasks inside each level in a universal dimensional model layer is avoided, the parallel number of the tasks is maximized and computer resources can be effectively utilized, so that the data processing efficiency of the data warehouse is improved. The invention also provides a corresponding data processing system for the data warehouse, which can realize the data processing method, which is disclosed by the invention, for the data warehouse.

Description

Technical field [0001] The invention relates to the field of databases, in particular to a data processing method and system for a data warehouse. Background technique [0002] Database is a warehouse that organizes, stores and manages data according to data structure. The processing of database data can be roughly divided into two categories: one is operational processing, which is usually used to query and modify a few records in the database; the other is analytical processing, which is generally used for The historical data is analyzed so that the data can be applied to decision-making. The subject-oriented, integrated, time-related, and unmodifiable data collection obtained after the analysis-type processing can be called a data warehouse. The main task of the data warehouse is to organize and reorganize information, and provide it to decision-makers in a timely manner. At present, data processing in a data warehouse is usually implemented through a distributed system, whi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F17/30
Inventor 徐玉鹏
Owner ADVANCED NEW TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap