Data processing method based on data warehouse

A data processing and data warehouse technology, applied in the data processing field based on data warehouse, can solve the problems of low accuracy of data warehouse, increase maintenance cost, and complex data sources, avoid data redundancy, facilitate traceability, and eliminate ambiguity. sexual effect

Active Publication Date: 2018-02-02
SHENZHEN AUDAQUE DATA TECH
View PDF7 Cites 15 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] In the existing technology, the data warehouse often has data redundancy and missing data, which will cause data inconsistency and increase maintenance costs; in addition, the data in the data warehouse is often from a variety of sources, the data is ambiguous, and the accuracy of the data warehouse is relatively low. Low

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method based on data warehouse
  • Data processing method based on data warehouse
  • Data processing method based on data warehouse

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0041] Embodiments of the technical solutions of the present invention will be described in detail below in conjunction with the accompanying drawings. The following examples are only used to illustrate the technical solution of the present invention more clearly, so they are only examples, and should not be used to limit the protection scope of the present invention.

[0042] It should be noted that, unless otherwise specified, the technical terms or scientific terms used in this application shall have the usual meanings understood by those skilled in the art to which the present invention belongs.

[0043] The invention provides a data processing method based on a data warehouse. Embodiments of the present invention will be described below in conjunction with the accompanying drawings.

[0044] figure 1 A flow chart of a data processing method based on a data warehouse provided by an embodiment of the present invention is shown. figure 2 It shows a data flow diagram of a...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a data processing method based on a data warehouse. The method comprises the following steps: an atomic layer acquires the structured first data; the atomic layer performs organization and classification on the first data according to a preset way so as to acquire the second data; the atomic layer performs partitional storage on the organized and classified second data; theatomic layer updates the second data to an integration layer; the integration layer performs merging processing on the second data according to a preset integration rule so as to generate the third data to store. The data inconsistency caused by data redundancy, data missing and like circumstances can be effectively avoided since the atomic layer performs organization and classification on the first data according to the preset way, and the maintenance cost is reduced; the partitional storage is performed on the organized and classified first data so that the information can be conveniently traced; the integration layer performs the merging processing on the second data so that the multi-source data can be integrated as the unique information, and then the ambiguity of the data is eliminated, and the unique accuracy of the data is guaranteed.

Description

technical field [0001] The invention relates to the technical field of data processing, in particular to a data processing method based on a data warehouse. Background technique [0002] With the expansion plan and deployment of the company's big data city project, the big data city data warehouse project will be the cornerstone project of every city, and it will be the multiplier and booster of all other data projects. [0003] In the existing technology, the data warehouse often has data redundancy and missing data, which will cause data inconsistency and increase maintenance costs; in addition, the data in the data warehouse is often from a variety of sources, the data is ambiguous, and the accuracy of the data warehouse is relatively low. Low. Contents of the invention [0004] Aiming at the above-mentioned defects in the prior art, the present invention provides a data processing method and system based on a data warehouse, which can effectively avoid data inconsiste...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
CPCG06F16/254G06F16/283
Inventor 黎仁全唐明辉李邱林贾西贝
Owner SHENZHEN AUDAQUE DATA TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap