Multiplexed Event Replay via Dynamic Routing Paths
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing event recordation systems face challenges in efficiently retrieving and replaying massive volumes of data from millions of IoT devices and web applications, particularly when events are multiplexed based on different partitions and topics than those initially recorded, leading to complexities in scaling and data persistence.
Innovation Solution
The implementation of a multiplexed event recordation system with a dynamic adaptability mechanism that routes events through a hierarchical structure of channels, allowing for rerouting and replay of events across physical aggregate channels, even when the initial recording path changes, ensuring data integrity and scalability.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If events are multiplexed based on different partitions and topics than initially recorded, then system scalability and capacity are improved, but data retrieval and replay complexity increases
Solution Approach 1:
The patent introduces a routing layer with virtual channels that act as intermediaries between event sources and storage systems. This routing layer manages the complexity of multiplexed event streams by providing a standardized interface for event routing based on dynamic rules, thereby improving scalability without proportionally increasing retrieval complexity.
Solution Approach 2:
The system segments event streams into multiple virtual channels based on dynamic rules and criteria. This segmentation allows independent management and routing of different event types through appropriate physical channels, enabling scalable system growth while maintaining organized data structures that simplify retrieval operations.
2Adaptability or versatility
If a reroute of recordation occurs in the multiplexed event recordation system, then system adaptability to changing conditions is improved, but data integrity and replay accuracy deteriorate
Solution Approach 1:
The system performs preliminary actions by recording metadata about event routing paths and channel configurations before events are routed. This pre-recording of routing information ensures that even when reroutes occur, the original routing context is preserved, maintaining data integrity and enabling accurate replay despite changes in system configuration.
Solution Approach 2:
The patent implements feedback mechanisms that track and record routing decisions and path changes. This feedback loop ensures that when reroutes occur, the system maintains awareness of the original routing context and can accurately reconstruct event paths for replay, thereby preserving data integrity while allowing system adaptability.
3Quantity of substance
If massive volumes of data from millions of devices are ingested, then data coverage and system capability are improved, but data ingestion speed and processing efficiency worsen
Solution Approach 1:
The patent merges multiple event streams from different sources into consolidated physical channels through virtual channel aggregation. This merging approach allows the system to handle massive volumes of data from millions of devices by combining similar event streams, thereby improving processing efficiency and ingestion speed while maintaining comprehensive data coverage.
Data Source
AI summary
A method for enabling event consumption is described. Upon receipt of a request for events associated with a first initial topic, a determination that the request includes a request for historical events is performed. Responsive to determining that one or more rules apply to the request for historical events, a determination of a first path from the first initial topic to a first aggregate topic is performed based on the one or more rules. The first path is different from a second path from the first initial topic to a second aggregate topic that is defined according to a current multiplexed framework definition. The current multiplexed framework definition is used for storing new events associated with the first initial topic in a second multiplexed event recordation system at a time that follows the time of receipt of the request. A first set of historical events is retrieved based on the first path.