Stream processing device and method of processing a stream of data

A stream processing and data stream technology, applied in the direction of electrical digital data processing, special data processing applications, digital data information retrieval, etc., can solve the problems of unusable distribution mode, growth, etc., to save resources/overhead, reduce data dimensionality , the effect of reducing the number of dimensions

Pending Publication Date: 2020-10-13
HUAWEI CLOUD COMPUTING TECH CO LTD
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0011] Current approaches to stream processing treat pattern matching as user-defined window functions or rather simple state machines, which have three major limitations
The first limitation is that target pattern descriptions are determined by custom user implementations or regular expressions that describe sequences of event types
The second limitation is that each window function keeps the entire sequence of events in the window cache (or state), which grows with the number of events contained in the window
A third limitation is that pattern matching requires iterating over the entire data for each trigger event
The main limitation of this approach is that it is only useful for fairly simple analysis and cannot be used in distributed mode, i.e. only for single machine state machines

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Stream processing device and method of processing a stream of data
  • Stream processing device and method of processing a stream of data
  • Stream processing device and method of processing a stream of data

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0064] figure 1 An example of a high-order stream processing device 100 according to an embodiment of the present invention is shown. The stream processing device 100 includes a processor 110 for processing a data stream 120 in a stream window 130 . Processor 110 may be implemented in hardware and / or software. Processor 110 may be part of a server, or may be a digital signal processor (DSP). Data stream 120 includes events or data items that then pass through stream window 130 .

[0065] Processor 110 is configured to generate or upgrade a high-level representation 140 from the content of stream window 130 . Higher order can be second order or third order, and can even include higher order. Higher order can be second order in time series form.

[0066] The processor 110 is configured to process the high-order representation 140 by performing at least one of: a dimensionality reduction transform, such as a discrete Fourier transform, a fast Fourier transform, an inverse fa...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The present invention provides a stream processing device (100) with a processor (110) for processing a stream of data (120) inside a streaming window (130). The processor (110) is configured to generate a higher order representation (140) from the content of the streaming window (130), and the processor (110) is configured to process the higher order representation (140).

Description

technical field [0001] The invention relates to a stream processing device and a data stream processing method. Background technique [0002] The invention aims at the field of big data distributed stream processing. A stream is a sequence of events, i.e., tuples containing various data, generated in time order by various sources such as sensors, machines or humans. The stream processing paradigm involves applying analytical functions to events in a stream. In a typical stream processing approach, it is assumed that such events are accumulated within certain bounds at a given time, and an analytic function is applied to the resulting collection. This collection of transient events is called a window. [0003] Stream processing engines provide tools for processing events on the fly (as they enter the system). In terms of data acquisition technology, the stream processing engine can support data arriving in real time from stream sources, as well as loading data pre-stored ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/2455G06F17/14G06F17/17G06F17/18
CPCG06F16/24556G06F16/24565G06F16/24568G06F16/2474
Inventor 斯蒂法诺·波托利拉杜·图多兰克里斯蒂安·阿克塞尼戈兹·布兰切李海林
Owner HUAWEI CLOUD COMPUTING TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap