Router Management in Event Stream Processing Clusters
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Deploying analytic tools and models in the Cloud for large-scale, geographically distributed, and highly dynamic sensors is challenging, particularly in scenarios like autonomous vehicles where immediate data processing and analysis are required.
Innovation Solution
A computer-readable medium with instructions that manage a router to route events between computing devices, creating a manager ESP model and engine to process and publish events, and selecting a computing device for further processing based on usage metrics, enabling efficient event stream processing across distributed systems.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If analytic tools and models are deployed in the Cloud for large-scale distributed sensors, then data processing capability is improved, but deployment complexity and latency increase
Solution Approach 1:
The system segments the event stream processing architecture into multiple independent components: event sources, event streams, ESP models, ESP engines, and routers. Each component operates independently and can be deployed separately, reducing overall deployment complexity while maintaining high processing capability.
Solution Approach 2:
The patent introduces routers as intermediary components that mediate between event sources and ESP engines. These routers manage the complexity of routing events through multiple processing pipelines, simplifying the deployment and configuration of analytic tools across distributed sensors.
2Productivity
If analytic tools and models are deployed in the Cloud for large-scale distributed sensors, then data processing capability is improved, but processing latency increases
Solution Approach 1:
The system performs preliminary actions by pre-configuring ESP models and routers before event processing begins. Event streams are pre-routed through defined pipelines, and ESP models are pre-compiled and loaded, enabling immediate processing of sensor events without configuration delays.
Solution Approach 2:
The patent implements continuous event stream processing where routers and ESP engines operate continuously without interruption. Event streams flow continuously through multiple processing pipelines, eliminating batch processing delays and ensuring real-time analytics capability.
3Adaptability or versatility
If event streams are processed through multiple ESP models and engines, then analytics capability is improved, but system complexity increases
Solution Approach 1:
The system segments analytics capability into multiple independent ESP models that can be selectively applied to different event streams. Each ESP model represents a discrete analytic function, allowing versatile analytics while maintaining manageable system complexity through modular design.
Solution Approach 2:
The patent creates universal routers that can route events to multiple different ESP models and engines based on configurable rules. This multi-functional routing capability provides versatile analytics across different sensor types and event streams without requiring separate specialized systems for each case.
Data Source
AI summary
A computing device manages a router. A manager engine is instantiated based on a manager engine definition and instantiates a manager ESPE based on a created manager ESP model. A router configuration file is created based on mapping information read from the manager configuration file that describes connectivity between an event publishing source and a source window of the manager ESPE. A router engine is instantiated based on the created router configuration file. A connector is started to receive an event based on the router configuration file. The event is received in the source window of the manager ESPE processed based on the manager ESP model. A third computing device is selected by the router engine based on a usage metric received from each window of a plurality of windows defined by a remote ESP model configured to further process the processed event when it is received.