Proxy Router Workload Balancing for Telephone Systems
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Contention among components in a telephone communication system can lead to workload imbalances, resulting in decreased performance and efficiency when servicing telephony requests, especially due to location-based and network infrastructure factors.
Innovation Solution
The system employs proxy servers and routers to monitor operational status and randomly select available components to service requests, using randomized delays to reduce contention among both proxy servers and telephone access servers, ensuring efficient and cost-effective service delivery.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If components are geographically dispersed to service telephony requests, then service coverage and responsiveness to local customers is improved, but workload imbalance and contention among components worsen
Solution Approach 1:
The system dynamically adjusts workload distribution by monitoring component operational status and using randomized selection with exponential backoff retry logic. This dynamic approach allows the system to adapt to changing load conditions and component availability, preventing static workload assignment from causing hot-spots while maintaining geographic dispersion benefits
Solution Approach 2:
The system changes the parameter of request routing from deterministic (always routing to nearest component) to probabilistic (randomized selection with retry). This parameter change transforms the workload distribution pattern, preventing any single component from becoming a permanent hot-spot while still allowing geographic proximity to influence routing decisions
2Reliability
If multiple components compete to service requests, then system redundancy and reliability are improved, but contention and processing delays worsen
Solution Approach 1:
The system performs preliminary actions by selecting a component before the request is fully processed, then immediately attempting to service the request. If the selected component is unavailable, the retry mechanism with exponential backoff activates, preventing the need to wait for component availability checks while maintaining redundancy benefits
Solution Approach 2:
The system skips the traditional sequential approach of checking component availability before routing requests. Instead, it rushes through by directly routing to a randomly selected component and handling failures through rapid retry mechanisms, reducing the time lost in availability checking while maintaining system reliability
3Speed
If requests are routed to nearest components, then response time is improved, but workload concentration and hot-spot formation worsen
Solution Approach 1:
The system introduces asymmetry by combining randomized component selection with exponential backoff retry logic. This creates an asymmetric workload distribution pattern where components that are currently less loaded receive more requests, while heavily loaded components naturally receive fewer requests, preventing hot-spot formation while maintaining fast response times
Solution Approach 2:
The system dynamically adjusts the effective routing destination through randomized selection and retry mechanisms. Rather than statically routing to the nearest component, the system dynamically determines which component services each request based on current conditions, preventing workload concentration while preserving geographic proximity benefits
Data Source
AI summary
A workload balancing technique enhances balancing of workloads processed by components of a telephone communication system configured to render telephony services over a computer network. The telephony services illustratively include private branch exchange (PBX) services suitable for customers with geographically dispersed telephone service demands. The workload balancing technique is invoked by the communication system to reduce contention among the components of the system, such as telephone access servers (TASes) coupled to a proxy router, when servicing telephony requests issued by the customers, thus enabling rendering of the telephony services in an efficient and cost-effective manner. As described herein, an available TAS is randomly selected to service a telephony request received by the proxy router from a network coupled to the communication system.