Unlock instant, AI-driven research and patent intelligence for your innovation.

A Streaming Data Cube Construction Method Based on Summary Structure

A construction method and streaming data technology, applied in the field of computer data statistics and analysis, to achieve the effect of real-time analysis

Inactive Publication Date: 2017-06-20
ZHEJIANG UNIV CITY COLLEGE
View PDF3 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] Aiming at the deficiencies in the prior art, the purpose of the present invention is to provide a stream data cube construction method based on a summary structure, so as to solve the shortcomings of the existing massive stream data in terms of storage space, processing speed, etc.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A Streaming Data Cube Construction Method Based on Summary Structure
  • A Streaming Data Cube Construction Method Based on Summary Structure
  • A Streaming Data Cube Construction Method Based on Summary Structure

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0032] The present invention proposes a stream data cube construction method based on a summary structure, which is used to solve the shortcomings of the data cube under massive stream data in terms of storage space and processing speed.

[0033] Constructing a streaming data cube with a summary structure includes the following steps:

[0034] Step S100: Propose an extensible data unit identification model, which generates a unique identification through pairing function mapping for any combination of dimensions of streaming data, and never conflicts.

[0035] The step S100 further includes:

[0036] Step S110: sort the same attribute values ​​in the required flow data cube according to their frequency, and map according to the order of natural numbers from small to large;

[0037] Step S120: For the different attribute values ​​in the required stream data cube, perform inversion according to the base of their values, so that the values ​​with widely distributed attribute val...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a method for establishing a streaming data cube based on a synopsis structure. The method includes the following steps that any dimension combination is mapped into a sole natural number, the dimension combinations are cut according to the top and bottom limitation monotonic principle, effective data unit information is saved in similar linear space, and a time series index is established. The method for establishing the streaming data cube based on the synopsis structure has the advantages that the real-time analysis requirement can be met in the similar linear storage space, and accuracy can be effectively controlled.

Description

technical field [0001] The invention belongs to the field of computer data statistics and analysis, in particular to a stream data cube construction method based on a summary structure. Background technique [0002] The development of the mobile Internet has brought more and more streaming data, such as IP address packets in routers, short text content in social media such as Weibo and WeChat, user commodity browsing behavior log information, etc. Streaming data is a set of sequential, A large, fast, and continuously arriving data sequence, which can generally be regarded as a collection of dynamic data that grows infinitely over time. [0003] Currently, there are two common stream data analysis methods based on data sampling and data compression. These methods regard the data as a whole and conduct global analysis, but do not regard streaming data as a series of continuous multi-dimensional data and perform analysis and mining at different levels. The aggregation operati...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F17/30
CPCG06F16/2228G06F16/2474
Inventor 吴明晖金苍宏胡宇响应晶朱凡微刘泽民
Owner ZHEJIANG UNIV CITY COLLEGE