Transaction Update Messaging Across Fast and Slow Data Paths
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In computing systems, latency between remote and local processors leads to discrepancies in information processing, with existing techniques like complex prediction models being imperfect and latency reduction methods offering limited improvements due to physical constraints.
Innovation Solution
A distributed computer system with a transaction processing system, gateway system, and session manager system, utilizing different communication protocols for data transaction requests and updates, where slower protocols include private attributes and faster protocols include only public attributes, ensuring accurate and timely information exchange.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If complex prediction models are used to address latency issues, then information accuracy may be improved, but system complexity increases and the models are not omniscient
Solution Approach 1:
The system segments information into public attributes and private attributes, transmitting them through different communication pathways. Public attributes are sent through faster pathways while private attributes use slower but more accurate pathways, resolving the contradiction by dividing the information transmission task rather than using complex prediction models.
Solution Approach 2:
The system introduces an intermediary mechanism (dual communication pathways with session managers) that coordinates between fast and slow information streams. This intermediary manages the integration of public and private attributes without requiring complex prediction models, achieving accuracy while controlling complexity.
2Loss of time
If latency between remote and local systems is decreased, then information synchronization is improved, but physical constraints limit the returns
Solution Approach 1:
The system divides information transmission into two segments: public attributes transmitted through fast pathways to reduce latency, and private attributes transmitted through slow pathways to ensure reliability. This segmentation allows the system to achieve both low latency and high reliability simultaneously.
Solution Approach 2:
Different communication pathways are assigned different quality characteristics - fast pathways for public information and slow pathways for private information. This local quality differentiation allows each pathway to optimize for its specific purpose, achieving overall system reliability while maintaining low latency for time-sensitive operations.
3Loss of information
If private information is included in communication pathways, then information completeness is improved, but transmission speed decreases
Solution Approach 1:
The system segments information into public and private attributes and transmits them through separate communication pathways. Public attributes use fast pathways while private attributes use slow pathways, allowing the system to maintain information completeness without sacrificing overall transmission speed for time-sensitive operations.
Solution Approach 2:
Different communication pathways are assigned different speed qualities based on their information type. Fast pathways handle public information where speed is critical, while slow pathways handle private information where completeness is more important. This local quality differentiation resolves the contradiction between information completeness and transmission speed.
Data Source
AI summary
A distributed computer system is provided that includes a storage system and at least one hardware processor. The storage system stores a data structure that includes a plurality of pending data transaction requests. Data transaction requests are processed to add, modify, or remove from the data structure. Multiple update messages for how the data structure is updated are generated and then delivered to clients via different communication paths, which have different latency. Some update messages are delivered via one communication path, but not another communication path.