Data processing method and data processing system

A data processing and data technology, applied in the fields of electrical digital data processing, special data processing applications, instruments, etc., can solve the problems of reduced data practicability, inconsistent data, and low standardization of historical data calibers, so as to improve efficiency and realize conversion. Effect

Inactive Publication Date: 2014-06-11
北京用友政务软件股份有限公司
View PDF5 Cites 45 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, a series of challenges are faced in the process of using traditional data warehouse technology to build a government data warehouse. Due to the relatively rough caliber and relatively low standardization of historical data, the data management caliber in different years and different regions is inconsistent, and there is a lack of business Unified conversion rules often require business personnel to confirm the conversion methods one by

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method and data processing system
  • Data processing method and data processing system
  • Data processing method and data processing system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0089] The original data in this embodiment is the government data of Jiangsu Province, and the total “indicator amount” and 2013 of the five prefecture-level cities of Nanjing, Wuxi, Xuzhou, Changzhou, and Suzhou are extracted from numerous government data as needed. "Expenditure amount", and the "indicator amount" and "expenditure amount" in the central and eastern regions of the five prefecture-level cities, as well as the "indicator amount" and "expenditure amount" of special caliber.

[0090] The above-mentioned "special caliber", like "prefectures and cities total" and "eastern region", refers to a statistical analysis caliber, but a caliber indicator. "Special caliber" is mainly used to identify data analysis calibers that cannot be classified as normal groups. There are various ways of caliber marking, and different caliber markings can be set according to needs. The "target amount" refers to the amount of fiscal expenditure that can be made in a certain district (such a...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a data processing method and a data processing system. The data processing method comprises the following steps: firstly, storing original data to a theme table, and recording codes and names of dimensions which need to generate a dimension table in the theme table; then, generating the corresponding dimension table according to the codes and the names, recorded in the theme table, of the dimensions; storing corresponding dimension table data to the dimension table, and generating the dimension ID of each dimension; generating a fact table related to the dimension table from the theme table according to the dimension ID of each dimension; storing corresponding fact table data into the fact table; finally, generating an application summary table from the fact table as needed to obtain application summary data, and storing to the application summary table. According to the method and the system, by adding the theme table and the application summary table in a data processing cycle, the data can be repeatedly utilized based on the theme table; through derived dimension-supported calculation, the conversion of a data analysis aperture is realize, and the data processing efficiency and the practicability of processed data are effectively improved.

Description

Technical field [0001] The invention relates to the technical field of data processing in a data warehouse, and in particular to a data processing method and system. Background technique [0002] With the rise of the concept of big data, government departments at all levels are actively using various structured and unstructured data generated in the process of government management based on data warehouse technology. The premise of traditional data warehouse technology is that the data has been clarified. How to use it, but the actual demand is that government departments need to collect the data first, and how to use the data has not yet been fully figured out. [0003] The basic principle of the traditional data warehouse technology is to extract the original data from the data source to the temporary area, after unified cleaning, conversion and processing, update to the dimension table and the fact table, through the data visualization tool based on the fact table and the dimens...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30
CPCG06F16/2282
Inventor 陈国强朱培冬郝栋姬永杰刘广财
Owner 北京用友政务软件股份有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products