Data processing method and data processing device for on-line analysis processing

A technology of online analysis processing and data processing device, which is applied in the field of data processing, can solve the problem of large memory overhead and achieve the effect of reducing memory overhead

Active Publication Date: 2014-02-26
BEIJING GRIDSUM TECH CO LTD
View PDF2 Cites 12 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] The main purpose of the present invention is to provide a data processing method and device for OLAP to solve the problem of relatively large memory overhead in OLAP in the related art

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method and data processing device for on-line analysis processing
  • Data processing method and data processing device for on-line analysis processing
  • Data processing method and data processing device for on-line analysis processing

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0025] It should be noted that, in the case of no conflict, the embodiments in the present application and the features in the embodiments can be combined with each other. The present invention will be described in detail below with reference to the accompanying drawings and examples.

[0026] An embodiment of the present invention provides a data processing method for online analysis processing.

[0027] figure 1 is a flowchart of a data processing method according to an embodiment of the present invention. As shown in the figure, the data processing method includes the following steps:

[0028] Step S101, acquiring a plurality of partitions obtained by partitioning data in OLAP. The data that needs to be processed online is usually stored in a certain partition according to certain rules, for example, stored in different time partitions according to time, such as partitioning according to each month, and the data of one year can be divided into 12 partitions. area, assum...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a data processing method and a data processing device for on-line analysis processing. The data processing method for on-line analysis processing comprises the following steps of acquiring data in on-line analysis processing and partitioning the data so as to obtain a plurality of partitions; respectively calculating user numbers of de-weighting counting indexes of the partitions; and adding the obtained user numbers of the de-weighting counting indexes of the partitions so as to obtain the user number of de-weighting counting in the on-line analysis processing. By using the data processing method, the problem that the cost for an internal memory when in on-line analysis processing is high in the prior art is solved, and the effect of reducing the cost for the internal memory when in on-line analysis processing is achieved.

Description

technical field [0001] The invention relates to the field of data processing, in particular to a data processing method and device for online analysis and processing. Background technique [0002] The deduplication index refers to the number of users such as "visitors", which is a non-accumulative index. When calculating, all the required data needs to be loaded into the memory, and then deduplication is performed, and finally the number of users is obtained. [0003] The non-accumulative index means that the index data cannot be superimposed. Assume that the online analytical processing is partitioned by time, for example, each month is divided into one district. If the number of users recorded in the partition in September is 100, the number of users recorded in the partition in October is 200, then the number of visiting users in the past two months (September and October) may be any value between 200 and 300 after deduplication. The values ​​obtained from the partitions...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
CPCG06F16/24556
Inventor 洪超
Owner BEIJING GRIDSUM TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap