Stream processing device and method of processing a stream of data

A stream processing and data stream technology, applied in the direction of electrical digital data processing, special data processing applications, digital data information retrieval, etc., can solve the problems of unusable distribution mode, growth, etc., to save resources/overhead, reduce data dimensionality , the effect of reducing the number of dimensions

CN111771195APending Publication Date: 2020-10-13HUAWEI CLOUD COMPUTING TECH CO LTD
4 Cites 0 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Publication Date
2020-10-13

Smart Images

  • Figure 1
    Figure 1
  • Figure 2
    Figure 2
  • Figure 3
    Figure 3
Patent Text Reader

Abstract

The present invention provides a stream processing device (100) with a processor (110) for processing a stream of data (120) inside a streaming window (130). The processor (110) is configured to generate a higher order representation (140) from the content of the streaming window (130), and the processor (110) is configured to process the higher order representation (140).
Need to check novelty before this filing date? Find Prior Art

Description

technical field

[0001] The invention relates to a stream processing device and a data stream processing method. Background technique

[0002] The invention aims at the field of big data distributed stream processing. A stream is a sequence of events, i.e., tuples containing various data, generated in time order by various sources such as sensors, machines or humans. The stream processing paradigm involves applying analytical functions to events in a stream. In a typical stream processing approach, it is assumed that such events are accumulated within certain bounds at a given time, and an analytic function is applied to the resulting collection. This collection of transient events is called a window.

[0003] Stream processing engines provide tools for processing events on the fly (as they enter the system). In terms of data acquisition technology, the stream processing engine can support data arriving in real time from stream sources, as well as loading data pre-stored ...

Examples

Embodiment Construction

[0064] figure 1 An example of a high-order stream processing device 100 according to an embodiment of the present invention is shown. The stream processing device 100 includes a processor 110 for processing a data stream 120 in a stream window 130 . Processor 110 may be implemented in hardware and / or software. Processor 110 may be part of a server, or may be a digital signal processor (DSP). Data stream 120 includes events or data items that then pass through stream window 130 .

[0065] Processor 110 is configured to generate or upgrade a high-level representation 140 from the content of stream window 130 . Higher order can be second order or third order, and can even include higher order. Higher order can be second order in time series form.

[0066] The processor 110 is configured to process the high-order representation 140 by performing at least one of: a dimensionality reduction transform, such as a discrete Fourier transform, a fast Fourier transform, an inverse fa...