Dynamic Router Group Selection for Cloud Network Scaling
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Service provider networks face inefficiencies in managing scalable computing resources due to the need to scale up or down router groups to handle varying user requests, leading to fragmentation and increased power and processing requirements.
Innovation Solution
Implementing a dynamic selection mechanism between router groups based on concurrent request thresholds, allowing for migration of user accounts and requests to router groups with higher bandwidth allocation, reducing the number of routers needed and minimizing fragmentation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If the number of routers is scaled up to handle increasing user requests, then the service provider network can service more concurrent requests, but the number of routing devices increases leading to higher power consumption and processing requirements
Solution Approach 1:
The patent implements dynamic selection of router groups based on concurrent request thresholds. The system monitors the number of concurrent requests and dynamically selects between different router groups (first router group with lower threshold, second router group with higher threshold) to handle varying load conditions. This dynamic approach allows the network to optimize router utilization and reduce power consumption by using fewer routers when demand is low, while still maintaining the capability to handle peak loads when necessary.
2Productivity
If the number of routers is scaled up to handle increasing user requests, then the service provider network can service more concurrent requests, but the number of routing devices increases leading to increased processing requirements
Solution Approach 1:
The system dynamically adjusts router group selection based on real-time monitoring of concurrent request thresholds. When the number of concurrent requests exceeds the first threshold but remains below the second threshold, the system selects the second router group which has fewer routers with higher individual processing capabilities. This dynamic selection optimizes processing power utilization by matching router capacity to actual demand, avoiding the waste of maintaining excessive processing power when demand is moderate.
3Adaptability or versatility
If router groups are scaled up or down to handle varying requests, then the network can adapt to demand changes, but fragmentation occurs among routers leading to inefficiencies
Solution Approach 1:
The patent implements a dynamic router group selection mechanism that monitors concurrent request thresholds and selects the appropriate router group accordingly. This dynamic approach maintains network adaptability by allowing the system to respond to demand changes, while simultaneously reducing fragmentation by consolidating traffic into fewer, more heavily-utilized routers in the second router group when demand exceeds the first threshold. The system thus achieves both adaptability and reduced complexity through intelligent dynamic selection.
Data Source
AI summary
This disclosure describes techniques implemented partly by a service provider network for dynamically selecting between router groups to account for scaling up and/or scaling down of managed instances that are serving concurrent requests. Router groups define bandwidth allowances for routers that restrict the number of machine instances the routers are allowed to manage for individual user accounts. As concurrency of requests increases for a user account, rather than using more routers in a router group with a smaller bandwidth allowance, the techniques described herein include selecting a different router group for the user account that defines larger bandwidth allowances for user accounts. The service provider network may determine that the number of concurrent requests for a user account has passed a threshold for a router group, and select a new router group for routing new requests and managing containers of instances that are processing the existing concurrent requests.