Unified Execution System for Keyed Network Data Streams
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional systems face latency and inefficiency in processing data records due to multiple disparate systems reformatting data multiple times, leading to delayed interactions and inability to process data in real-time or near real-time, which renders dependent actions obsolete.
Innovation Solution
A system that integrates data collection, validation, and processing within a single execution system, allowing for immediate data processing and action execution without storing data, using parameterized applications to collect, detect, and act on data streams in real-time or near real-time.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If multiple disparate systems are used to process data records, then each system can be configured to process specific data types, but latency increases due to multiple reformatting operations and delayed interactions between systems
Solution Approach 1:
The patent merges multiple disparate data processing systems into a single unified system that can handle multiple data types. This unified system eliminates the need for multiple separate systems to pass data between each other, thereby removing the latency caused by inter-system communication and multiple reformatting operations while maintaining the ability to process diverse data types through a single standardized interface
2Ease of manufacture
If each system performs its own data formatting and reformatting, then data can be processed by specialized systems, but latency accumulates due to multiple formatting operations on the same data record
Solution Approach 1:
The patent segments the data processing function into two distinct parts: a single standardized formatting layer that prepares data once, and multiple specialized processing components that consume the formatted data without reformatting. This segmentation allows each component to be optimized for its specific function while eliminating the accumulated latency of multiple formatting operations on the same data record
3Productivity
If data is processed through multiple systems with individual formatting, then comprehensive processing can be achieved, but real-time or near real-time processing becomes impossible due to processing delays
Solution Approach 1:
The patent creates a universal data processing architecture where a single standardized formatting interface serves multiple specialized processing functions simultaneously. This multi-functional design allows the system to perform comprehensive data processing across different data types and processing requirements while maintaining real-time capability, as all processing paths share the same efficient formatting layer rather than requiring separate formatting operations for each path
Data Source
AI summary
A method is described for processing keyed data items that are each associated with a value of a key, the keyed data items being from a plurality of distinct data streams, the processing including collecting the keyed data items, determining, based on contents of at least one of the keyed data items, satisfaction of one or more specified conditions for execution of one or more actions and causing execution of at least one of the one or more actions responsive to the determining.