Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Data processing method and device for slowly changing dimension table and electronic device

A data processing and dimension table technology, applied in the field of data processing, can solve problems such as large storage space, and achieve the effect of saving storage space

Pending Publication Date: 2019-02-22
CHINA PING AN LIFE INSURANCE CO LTD
View PDF4 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, when the dimension tables are large, such as e-commerce product data and hundreds of millions of user data, this solution will use a large amount of storage space

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method and device for slowly changing dimension table and electronic device
  • Data processing method and device for slowly changing dimension table and electronic device
  • Data processing method and device for slowly changing dimension table and electronic device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0043] Example embodiments will now be described more fully with reference to the accompanying drawings. Example embodiments may, however, be embodied in many forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete and will fully convey the concept of example embodiments to those skilled in the art. The described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are provided in order to give a thorough understanding of embodiments of the present disclosure. However, those skilled in the art will appreciate that the technical solutions of the present disclosure may be practiced without one or more of the specific details being omitted, or other methods, components, devices, steps, etc. may be adopted. In other instances, well-known technical solution...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

That present disclosure belongS to the field of data processing technology, and relates to a data processing method and device for slowly changing dimension table, a computer readable storage medium,and an electronic device. The method comprises the following steps: a first data partition corresponding to the time range is created according to a preset time range; the first data partition is usedfor storing the value before the primary key of the slowly changing dimension table is updated in the time range, and the primary key is updated not more than once in the time range; a second data partition is created, and the second data partition is used for storing the value before the primary key of the slowly changing dimension table is updated;; the latest value of the primary key in the first data partition prior to the target service time is extracted to obtain historical total data of the target service time; A value of the primary key in the second data partition is extracted to obtain a full amount of data of a current query time. On the one hand, this method saves a lot of storage space, on the other hand, it can reproduce the full amount of data every day.

Description

technical field [0001] The present disclosure relates to the technical field of data processing, in particular, to a data processing method for a slowly changing dimension table, a data processing device for a slowly changing dimension table, a computer storage medium, and electronic equipment. Background technique [0002] With economic development and social progress, terminal devices such as computers and tablets have become the main tools for people to live and work. Every operation people perform on terminal devices will be stored in the data warehouse in the terminal device in the form of data. These data can be It is used to analyze the cause of user behavior or program failure. [0003] One of the main requirements of the data warehouse is to retain historical data. At the same time, in order to ensure the efficiency of data association, it is generally required that one ID in a dimension table corresponds to only one record. As a result, a contradiction that is dif...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F16/22
CPCY02D10/00
Inventor 崔晓晖
Owner CHINA PING AN LIFE INSURANCE CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com