Transaction Reorder Buffer for Jitter-Resilient Order Processing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
High-performance distributed systems, such as electronic trading systems, face challenges in maintaining deterministic chronological ordering of transactions due to jitter, which causes transactions to arrive out of order at the server.
Innovation Solution
Implementing a reorder buffer between the server and the network to re-order out-of-order transactions based on their original timestamps, ensuring that transactions are processed in the order they were received.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If transactions are processed in the order they arrive at the server, then processing speed is improved, but chronological ordering accuracy deteriorates due to jitter
Solution Approach 1:
The system attaches timestamps to transactions at the point of entry into the network before processing occurs. This preliminary action records the original chronological order, allowing the matching engine to later reorder transactions based on these pre-captured timestamps rather than arrival order, thus resolving the contradiction between processing speed and chronological accuracy
Solution Approach 2:
The patent introduces an intermediary mechanism (timestamp and reordering buffer) between the network and the matching engine. This intermediary captures the original transaction order via timestamps and reconstructs it before presenting transactions to the matching engine, allowing the system to process transactions quickly while maintaining chronological accuracy through the intermediary's mediation
2Manufacturing precision
If a reorder buffer is implemented to maintain chronological ordering, then ordering accuracy is improved, but system complexity increases
Solution Approach 1:
The patent changes the parameter representation by using simple numerical timestamps attached to each transaction instead of complex reordering logic. The matching engine processes transactions based on these timestamp parameters, transforming a complex ordering problem into a simple parameter-based sorting operation that maintains accuracy without excessive complexity
3Speed
If network transmission speeds are increased, then overall transaction speed is improved, but jitter impact becomes more significant
Solution Approach 1:
By attaching timestamps at the network entry point before high-speed transmission occurs, the system preliminarily records the true chronological order. This allows the matching engine to later reconstruct the correct order despite jitter-induced reordering during fast transmission, thus maintaining reliability while benefiting from increased transmission speed
Solution Approach 2:
The timestamp mechanism provides feedback about the original transaction order to the matching engine. This feedback loop allows the system to compensate for jitter effects by comparing arrival order against the timestamp-based original order, ensuring that increased transmission speed does not compromise chronological accuracy
Data Source
Figure 1A
Figure 1B
Figure 2A
AI summary
The described technology relates to a real-time order processing systems such as, for example, an electronic trading application for equities and other tradable investment instruments. An example system relates to reordering messages received at a server over a communication network from distributed clients, in order to, among other things, eliminate or at least substantially reduce the effects of jitter (delay variance) experienced in the network. The reordering of messages may enable the example electronic trading system to improve the consistency of executing orders (e.g., performing transactions for buying/selling electronic inventories) in the time order of when the client's order entered the trading system's network.