Transaction Request Message Buffering and Deduplication for Latency Fairness
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Data transaction processing systems face disparities in latency and processing times due to varying network connections and speeds among client computers, leading to increased costs and computing resource demands for maintaining fast connections, and congestion at network ingress points, which can result in denial of service and packet loss.
Innovation Solution
The system mitigates latency disparities by buffering and arbitrating electronic data transaction request messages, compressing messages before processing, and implementing a latency floor to reduce the need for rapid transaction submissions, thereby reducing the incentive for high-speed connections and minimizing redundant processing.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If client computers continuously obtain and maintain the newest network connection technologies to reduce latency, then transaction transmission speed is improved, but cost becomes prohibitive
Solution Approach 1:
The patent introduces a message management module as an intermediary between client computers and the matching processor. This module buffers incoming messages, compresses them to reduce size, and eliminates redundant messages from common sources. By processing messages through this intermediary layer, the system reduces the need for client computers to maintain expensive high-speed connections, as the bottleneck is shifted to the server-side message management infrastructure.
2Productivity
If the data transaction processing system processes electronic data transaction request messages as they are received to maintain fast processing, then transaction execution speed is improved, but computing resources must be continually invested
Solution Approach 1:
The message management module performs preliminary actions on incoming messages before they reach the matching processor. Messages are buffered temporarily, compressed to reduce data size, and redundant messages are eliminated. This preliminary processing reduces the computational burden on the matching processor, allowing it to maintain high transaction execution speed without requiring continual investment in additional computing resources.
3Reliability
If multiple messages from common sources are processed individually to maintain processing accuracy, then transaction integrity is preserved, but network ingress congestion increases
Solution Approach 1:
The message management module merges multiple messages from common sources by identifying and eliminating redundant messages. When multiple messages originate from the same source with identical or substantially similar information, the module consolidates them into a single processed message. This merging approach maintains transaction integrity by ensuring accurate processing while significantly reducing network ingress congestion and improving overall network throughput.
Data Source
AI summary
A data transaction processing system receives electronic data transaction request messages from client computers over a data communication network and groups a subset of the electronic data transaction request messages. The data transaction processing system may preprocess the group of electronic data transaction request messages based on the other messages in the same group before forwarding the electronic data transaction request messages to a transaction processor.