Context Partitioned Event Sorting for Distributed Monitoring
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing event monitoring systems face inefficiencies in processing events from distributed applications, as they often require multiple event processing systems and struggle to apply monitoring rules effectively across different context partitions, leading to increased latency and complexity.
Innovation Solution
An event monitoring system with two stages: an event sorting stage that identifies and forwards events to corresponding event processing systems based on context partitions, allowing for efficient processing of events within a single system, even for distributed applications.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If events from distributed applications are processed by multiple event processing systems, then the system can handle distributed applications, but the processing latency increases and efficiency decreases
Solution Approach 1:
The patent segments the event processing system by introducing context partitions that divide the event stream into distinct segments. Each context partition is assigned to a specific event processing system, allowing events within the same partition to be processed by a single system. This segmentation reduces cross-system communication and latency while maintaining the ability to handle distributed applications through multiple partitions.
Solution Approach 2:
The patent introduces an event sorting system as an intermediary between event sources and event processing systems. This sorting system receives events, determines their context partition, and routes them to the appropriate processing system. The intermediary enables efficient event distribution and ensures that related events are processed by the same system, reducing latency.
2Productivity
If events are distributed across multiple event processing systems, then the system can scale, but the complexity of applying monitoring rules increases
Solution Approach 1:
The patent applies local quality by associating specific monitoring rules with specific context partitions. Each event processing system applies only the monitoring rules relevant to its assigned partitions, rather than managing all rules across the entire system. This localization reduces the complexity each system must handle while maintaining overall scalability.
Solution Approach 2:
The patent segments both the event stream into context partitions and the monitoring rules into partition-specific rule sets. This dual segmentation allows the system to scale by adding more processing systems and partitions while keeping the rule application complexity manageable at each node.
3Device complexity
If a single event processing system processes all events, then rule application is simplified, but the system cannot efficiently handle distributed applications with different context partitions
Solution Approach 1:
The patent creates a universal context partitioning mechanism that can handle both single-application and distributed-application scenarios. The same event sorting and partitioning infrastructure works whether events come from one application or multiple distributed applications, providing multi-functionality without requiring separate processing paths.
Solution Approach 2:
The patent adds the dimension of context partitioning to the event processing architecture. Instead of organizing events solely by application source, events are organized by their context partition, which can encompass multiple applications. This additional organizational dimension enables efficient handling of distributed applications while maintaining simplified rule application within each partition.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
An event monitoring system that includes two stages, an event sorting stage and an event processing stage. The event sorting stage receives events provided by at least one application, and includes multiple event sorting systems. The event processing stage includes at least one event processing system that processes events forwarded by the event sorting stage. The event processing system(s) is/are capable of processing events that fall within a particular set of one or more context partitions that correspond to the respective event processing system. As the event sorting system receives an event, the event sorting system identifies which context partition the event falls within. The event sorting system then identifies the event processing system that corresponds to the identified context partition of the event, and then forwards the event to the identified event processing system. The event processing system then applies the set of one or more monitoring rules.