Event Broker Marshalling for Publish-Subscribe Systems
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In publish-subscribe systems, subscribers often face inefficiencies in receiving events due to the store and forward function, where they may not wish to receive all events, leading to unnecessary processing and resource utilization.
Innovation Solution
A method and system where an event broker receives subscription requests with specific parameters, marshals events based on these parameters, and delivers them to subscribers, including batching or combining events to align with the subscriber's defined event receive rate, thereby optimizing event delivery and reducing unnecessary processing.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If the store and forward function is used to route all events from publishers to subscribers, then event delivery completeness is improved, but resource utilization deteriorates due to unnecessary processing of unwanted events
Solution Approach 1:
The system performs preliminary filtering and marshalling of events based on subscription parameters before delivering events to subscribers. The event broker pre-processes events by matching them against subscription criteria, so that only relevant events are forwarded to each subscriber. This preliminary action prevents unnecessary processing and resource consumption while ensuring complete delivery of all relevant events.
2Adaptability or versatility
If all events are delivered to subscribers without filtering, then event availability is improved, but processing efficiency deteriorates due to unnecessary event handling
Solution Approach 1:
The event broker applies different filtering and marshalling operations tailored to each subscriber's specific subscription parameters. Instead of a uniform filtering approach, the system customizes event processing for each subscriber based on their individual needs, topics of interest, and event receive rate preferences. This local quality approach ensures high event availability for relevant events while maximizing processing efficiency by avoiding unnecessary events for each subscriber.
3Measurement precision
If machine learning models process all received events, then inference accuracy is improved, but computational overhead increases due to processing unnecessary events
Solution Approach 1:
The event broker extracts and delivers only the specific events that match subscriber subscriptions to machine learning models. By filtering out unrelated events before they reach the ML models, the system ensures that models receive complete information about relevant events (maintaining inference accuracy) while dramatically reducing the volume of events that require computational processing (reducing computational overhead).
Data Source
AI summary
A computer-implemented method comprises receiving a subscription request from at least one subscriber, the subscription request defining one or more subscription parameters; obtaining one or more events from at least one publisher; marshalling the one or more events according to the one or more subscription parameters; and delivering the one or more events to the subscriber based on the marshalling.


