Supercharge Your Innovation With Domain-Expert AI Agents!

CEP rule updating method based on Flink streaming engine

An update method and rule technology, applied in database update, special data processing application, instrument, etc.

Pending Publication Date: 2021-03-16
福建省海峡信息技术有限公司
View PDF0 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The present invention provides a method for updating CEP rules based on the Flink streaming engine, one of which is to have the ability to update downstream operator nodes and solve the problem of only updating stream-combined operator nodes; the other purpose is to In order to solve the problem that the CEP rules need to rewrite and update the business code to achieve the effect of simplifying the update process

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • CEP rule updating method based on Flink streaming engine
  • CEP rule updating method based on Flink streaming engine

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0027] like figure 1 As shown, the present invention provides a method for updating CEP rules based on the Flink streaming engine, comprising the following steps:

[0028] Step 1: Each task loads the initial rules from an external file. The initial rules are multiple rule lists containing rule numbers, which are stored in memory according to the key-value pairs. In addition, the task accesses the event stream from the external message engine, and according to the loaded rules for analysis;

[0029] Step 2: Obtain the rule data that needs to be updated from the external cache or the system, then broadcast it, and combine it with the event stream. Each task obtains the combined stream at this operator node;

[0030] Step 3: According to the number of the update rule, compare it with the key of the operator node in step 2. If they are the same, convert this update rule into an event flow with a special flag. If there are multiple concurrent nodes at this time, you need to copy m...

Embodiment 2

[0034] like figure 1 As shown, the present invention provides a method for updating CEP rules based on the Flink streaming engine, and the method for updating CEP rules based on the Flink streaming engine also includes the following steps:

[0035] S1: At the combined flow node where the event flow and the rule flow are combined, update the rules of the rule flow, and analyze the event flow after updating the rules;

[0036] S2: After the updated rules analyze the event flow, additional processing services are written, and the newly written processing services are used to perform correlation analysis on each event, thereby completing the rule update for all operator nodes.

[0037]In this embodiment, the task accesses the event stream from the external message engine, analyzes according to the loaded rules, obtains the rule data that needs to be updated from the external cache or the system, and then broadcasts it. The update rule is converted into an event flow with a specia...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a CEP rule updating method based on an Flink streaming engine, and relates to the technical field of CEP rule updating methods, the CEP rule updating method comprises the following steps: each task loads an initial rule from an external file, stores the initial rule in a memory according to a key value pair, accesses an event stream from an external message engine, and performs analysis according to the loaded rule; rule data to be updated is acquired from an external cache or a system, the rule data is broadcasted, and the rule data is combnied with the event stream. According to the method, a task accesses an event stream from an external message engine, performs analysis according to a loaded rule, obtains rule data needing to be updated from an external cache ora system, then broadcasts the rule data, only needs to obtain the rule once in a rule base, and converts the updating rule into the event stream with a special mark; if the downstream operator has only one parallelism degree, an event is generated, and if the downstream operator has a plurality of parallelism degrees, a plurality of corresponding events are generated, the type field of the eventis changed into a rule type, the serial number of the event is changed into the serial number of the rule, and other corresponding fields are updated.

Description

technical field [0001] The present invention relates to a method for updating CEP rules, relates to the technical field of methods for updating CEP rules, and in particular to a method for updating CEP rules based on a Flink streaming engine. Background technique [0002] The update rules of the data flow engine are generally read from the cache, and the rules are generated into a stream, and then combined with the event stream, the original rules are replaced on the joint node, and then the new rules can be used for analysis. Although it is a combined stream, but The events of the two streams still need to be processed separately. In addition, the analysis of the event stream of the CEP library cannot be directly analyzed, and additional business logic codes need to be added for analysis. There are following problems at prior art: [0003] 1. The existing rule update method can only update the operator nodes of the combined flow, but cannot update the downstream operator n...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/23G06F16/2455
CPCG06F16/23G06F16/24568
Inventor 黄诗贤唐敏赖建华
Owner 福建省海峡信息技术有限公司
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More