Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Rule-based stream data processing method and unified monitoring platform

A technology of streaming data and processing methods, applied in electrical digital data processing, special data processing applications, hardware monitoring, etc., can solve problems such as single language, inability to stream structure collection, inability to meet distributed conditions, etc., to reduce learning. Cost, improve development efficiency, high availability effect

Inactive Publication Date: 2018-04-20
QIANXUN SPATIAL INTELLIGENCE INC
View PDF6 Cites 7 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

At the same time, the amount of data is increasing day by day, and the analysis framework of the original Local mode can no longer cope with the existing data volume
Although the traditional streaming analysis platform can perform distributed computing to expand performance, it cannot solve the huge development costs caused by frequent business changes
[0004] The rule engines in existing technical solutions, such as the Java-based rule engine Drools, support a single language and cannot meet the existing distributed conditions
Such rule engines cannot integrate well with streaming structures

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Rule-based stream data processing method and unified monitoring platform

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0026] The present invention is applied to any scene that needs to use a flow processing framework, and a rule engine and a dynamic compilation component are added to the original operation framework, and at the same time, all data streams are uniformly matched through the rule engine. The rules in the memory also need a certain update frequency to ensure the timeliness of adding new rules.

[0027] In the face of the explosion of data volume, the present invention can expand horizontally to ensure the completion efficiency of tasks; in the face of complex business changes, it can reduce development costs through rule matching, avoiding repeated version changes and bringing a lot of repetitive labor; Real-time data monitoring needs, no need to write a separate monitoring platform. The present invention only needs to add business rules in the data rule engine, add scheduling rules and input and output rules in the configuration engine, deploy once and add multiple times. Under...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a rule-based stream data processing method and a rule-based stream data unified monitoring platform. A distributed stream processing framework can be adapted; and rules are dynamically identified, loaded, compiled and sent to a distributed environment, so that matching data is dynamically generated. For complex data and varied business demands, a data generation mode of one-time deployment and flexible rule addition is proposed, and a one-stop data processing platform integrating distributed processing, stream processing, regularization and monitoring is provided, so that the development cost is reduced, the learning difficulty is lowered, and the spatial complexity and the time complexity of data processing are greatly lowered.

Description

technical field [0001] The invention relates to the technical fields of distributed computing, streaming computing, and rule engines, and in particular to a unified monitoring platform for a rule-based streaming data processing method. Background technique [0002] In recent years, big data has gradually become the focus of attention, especially streaming data in big data, because of its low latency, high performance, high concurrency and other characteristics, it has become a solution favored by more and more enterprises. However, due to the diversity of data and the complexity of business, the development cost and change cost of the traditional stream processing framework are very huge, which can no longer meet the current requirements. [0003] Take the company's complex business statistics requirements as the scenario. In this scenario, the business requirements are complex and changeable, and it is often necessary to separately monitor some abnormalities or some attenti...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F8/41G06F11/30G06F17/30
CPCG06F8/41G06F11/3006G06F16/182
Inventor 曲洋
Owner QIANXUN SPATIAL INTELLIGENCE INC
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com