Quarantine-Based Message Routing for Network Congestion Reduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Data transaction processing systems experience network congestion and latency due to high volumes of simultaneous requests, leading to unpredictable response times and potential loss or delay of messages, especially in financial markets like the Chicago Mercantile Exchange (CME).
Innovation Solution
Implementing a quarantine system that selectively delays certain messages based on their ability to accept a delay, allowing for more efficient transaction processing by managing network congestion and reducing the number of concurrent messages, thereby improving bandwidth utilization and processing speed.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If the data transaction processing system receives and processes all transaction requests immediately, then the system maintains high processing speed and responsiveness, but network congestion and processing latency increase significantly
Solution Approach 1:
The patent applies preliminary action by pre-processing and queuing transaction requests before they are fully processed. The system performs initial validation, routing determination, and queue assignment on incoming requests, preparing them in advance for subsequent processing stages. This reduces the critical path delay during actual transaction execution while maintaining high throughput by keeping the processing pipeline continuously fed with prepared requests.
2Productivity
If the system processes all transaction requests concurrently, then overall throughput is maximized, but network bandwidth utilization becomes inefficient and congestion occurs
Solution Approach 1:
The patent segments the transaction processing system into multiple independent processing channels, each handling specific types or priorities of transactions. Requests are divided and distributed across these segments based on their characteristics, allowing parallel processing without overwhelming any single network path. This segmentation enables efficient load balancing and prevents network congestion while maintaining high overall throughput through coordinated multi-channel processing.
3Adaptability or versatility
If client computers with slower connections submit transaction requests, then system accessibility is improved, but these clients experience higher latency and may miss transaction opportunities
Solution Approach 1:
The patent applies local quality by providing differentiated processing priorities and queue assignments based on client characteristics and request types. Clients with slower connections can have their requests assigned to priority queues or processed with relaxed timing requirements for non-critical transactions, while maintaining standard processing for time-sensitive operations. This localized adaptation allows the system to accommodate diverse client capabilities without compromising the responsiveness required for critical financial transactions.
Data Source
AI summary
A data transaction processing system includes a quarantine system that delays messages configured to accept a delay before being processed by the data transaction processing system. During periods of heavy network traffic, the imposed delay reduces network congestion by distributing/load leveling messages according to available computing resources. Separating messages over time also reduces the processing latency of the data transaction processing system. Messages that are routed and delayed through the quarantine system may be executed at a better transactional value than other non-delayed messages.