System and method for stream processing

An event stream and event technology, applied in special data processing applications, multi-program devices, etc., to achieve the effect of efficient resource use

Active Publication Date: 2019-07-26
HUAWEI CLOUD COMPUTING TECH CO LTD
View PDF12 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Additionally, the system may need to be sca

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • System and method for stream processing
  • System and method for stream processing
  • System and method for stream processing

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0037] The present invention relates to a data stream processing system in some of its embodiments, and more specifically but not only to the distributed processing of data in a big data system.

[0038] As used herein, the term "event" refers to a data instance, and the term "event stream" refers to a continuous sequence of data instances or events.

[0039] Window stream operators are software objects used to process windows of data instances (also called events), which are selected by applying filters to some events in the event stream. The term "operator" as used herein refers to window stream operators.

[0040] In a typical system using window stream operators, each operator applies a function to the events it receives and produces an output event stream. A typical operator applies a function to an event sliding window and has a working event set at any given moment. The function may be a calculation function that is applied to the work event set and generates a result event ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

A system and method for processing an input stream of events using a function f, to obtain an output stream of events are provided and are configured for: selecting from the input stream of events a plurality of consecutive events using a sliding window, as sliding window events; applying the function to the sliding window events, to obtain an output result value; iteratively: outputting the output result value on the output stream of events; splitting the sliding window events into a set of complying events that satisfy at least one filter test and a set of pending events; applying the function on the set of pending events to obtain at least one preliminary value; selecting from the stream of events a second plurality of events; adding the second plurality of events to the sliding windowevents; removing from the sliding window events the set of complying events, to obtain a new set of sliding window events; applying the function to the second plurality of events, and the at least onepreliminary value, to obtain a new output result value.

Description

Background technique [0001] In some of its embodiments, the present invention relates to a data stream processing system, and more specifically, it not only relates to distributed processing of data in a big data system. [0002] The term "big data" is used to refer to such a large and / or so complex data collection that traditional data processing applications cannot adequately handle such collections. One of the challenges of dealing with big data is analyzing the large amount of data in the collection. In some systems, data is an ordered sequence of data instances or events, called data streams or event streams. [0003] In a typical batch processing system, the data can be accessed as many times as needed to perform the required processing. In a stream processing system, data arrives continuously but cannot be stored for future reference. It may be necessary to constantly calculate mathematical or statistical analysis within the event stream at runtime. In some systems, large...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F9/46
CPCG06F9/46G06F16/24568G06F16/24552
Inventor 拉杜·利维乌斯蒂法诺·波托利朱星戈兹·布兰切克里斯蒂安·阿克塞尼
Owner HUAWEI CLOUD COMPUTING TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap