Virtual Queue Routing for Server Pools with Feedback
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional routing methods for networks with feedback require explicit a priori knowledge and measurement of customer input flow rates, leading to high complexity and a lack of robustness in responding to sudden changes in input rates.
Innovation Solution
Implementing a virtual queuing system that automatically routes requests based on actual arrivals, without explicitly solving linear programs or measuring input rates, allowing for lower implementation complexity and higher robustness.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If conventional routing methods explicitly solve linear programs and measure input rates, then routing decisions can be optimized, but implementation complexity increases and robustness decreases
Solution Approach 1:
The patent creates a virtual shadow system that copies the essential dynamics of the real queuing system without requiring full measurement and optimization machinery. The virtual system maintains virtual queue lengths that mirror the real system's behavior, allowing routing decisions to be made based on these simplified virtual states rather than solving complex linear programs with complete input rate measurements.
2Productivity
If conventional routing methods explicitly solve linear programs, then routing optimization is achieved, but response time to changes increases due to multiple iterations needed
Solution Approach 1:
The virtual shadow system dynamically adapts to changes in the real system's input rates and service patterns in real-time. When the real system experiences sudden changes in arrival rates or service times, the virtual queue lengths automatically reflect these changes, allowing immediate adjustment of routing probabilities without waiting for iterative linear program solutions to converge.
3Productivity
If conventional routing methods measure input rates explicitly, then accurate routing optimization is possible, but system robustness decreases when input rates are unknown or change suddenly
Solution Approach 1:
The virtual shadow system incorporates feedback from the real system's actual performance rather than relying on pre-measured input rates. By continuously observing service times and queue dynamics in the real system and reflecting them in the virtual system, the routing probabilities are automatically adjusted based on actual system conditions, making the system robust to unknown or changing input rates.
Data Source
AI summary
Example embodiments are directed to methods of routing requests within a system having a plurality of server pools. At least one of the methods provides a method of routing requests within a system having a plurality of server pools. The method includes receiving a request at the system, first determining a first value associated with a first request type of the received request and second determining a probability of routing based on the first value and a probability of rerouting. The first value is a virtual queue value for requests of the first request type. The second determining is performed without determining an input rate at which the requests of the first request type are received. The received request is routed to at least one of the plurality of server pools based on the probability of routing.