Method and equipment for compressing streaming data

A technology for compressing streams and stream data, which is applied in the field of information processing and can solve problems such as insufficient compression rate and low storage space requirements.

Active Publication Date: 2016-06-15
HUAWEI TECH CO LTD
View PDF10 Cites 7 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, in the existing methods for compressing streaming data, the compression rate is not high enough, so that the requirement for storage space is not the minimum

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and equipment for compressing streaming data
  • Method and equipment for compressing streaming data
  • Method and equipment for compressing streaming data

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0086] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are some of the embodiments of the present invention, but not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.

[0087] Streaming data can be represented as a time series S = {p 1 ,p 2 ,...,p i ,…}, where a point p in the time series i =(t i ,y i ) is a data point in the flow data, which means that at t i The value of the data collected at any time is y i .

[0088] It can be understood that the flow data includes multiple data points, and each data point includes two numbers, respectively representing the collection time and the data value collected at th...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention provides a method for compressing streaming data. The method comprises the following steps: constructing a plurality of segments according to acquired streaming data and a predefined maximum error; determining a target piecewise linear function according to the plurality of segments, wherein the target piecewise linear function comprises a plurality of linear functions, and the intersection of a value range of independent variables of every two linear functions in the plurality of linear functions at most includes one value; and outputting a reference data point according to the target piecewise linear function, wherein the reference data point comprises a continuous point and a discontinuous point of the target piecewise linear function. Therefore, in the embodiment of the invention, the plurality of segments are constructed according to a plurality of data points and the maximum error, further the target piecewise linear function is determined according to the plurality of segments, and the continuous point and the discontinuous point of the target piecewise linear function are used for representing compressed streaming data. The method of the embodiment of the invention can guarantee that the target piecewise linear function has a minimum number of parameters, so that the requirement for a storage space is the lowest.

Description

technical field [0001] Embodiments of the present invention relate to the field of information processing, and more specifically, relate to a method and device for compressing streaming data. Background technique [0002] Streaming data is a set of sequential, massive, fast, and continuously arriving data sequences. In general, streaming data can be viewed as a collection of dynamic data that grows infinitely over time. Streaming data is widely used in network monitoring, sensor networks, aerospace, meteorological measurement and control, and financial services. Through convective data research, satellite cloud image monitoring, stock market trend analysis, and network attack judgment can be carried out. [0003] In the process of real-time observation or storage of streaming data, due to the limitation of storage space, the streaming data needs to be compressed first. [0004] For the same set of streaming data, the higher the compression rate, the lower the storage space...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H03M7/30
CPCH03M7/3064H03M7/30
Inventor 李震国罗戈易珂范伟何诚
Owner HUAWEI TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap