Dynamic Network Farm Scaling via Message Router
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Network farms face inefficiencies due to statically configured server capacity, leading to excess idle servers during low demand periods, as they typically build out capacity to handle demand spikes, resulting in wasted resources.
Innovation Solution
Implementing an application message router that dynamically adds or removes servers from the network farm based on real-time traffic load, using APIs to manage traffic routing and performance reporting, allowing for seamless scaling up or down in response to demand changes.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If network farms build out enough capacity to handle demand spikes, then service reliability is improved during peak periods, but server utilization deteriorates during low demand periods resulting in wasted resources
Solution Approach 1:
The patent implements dynamic capacity adjustment by allowing the network farm to scale server resources up or down based on real-time demand conditions. The system monitors traffic patterns and automatically provisions or deprovisions server capacity, transforming the static infrastructure into a dynamic system that adapts to changing workloads, thereby maintaining high utilization during low demand while ensuring sufficient capacity during peak periods
Solution Approach 2:
The system changes the operational parameters of the network farm by adjusting the number of active servers based on demand metrics. When demand is low, the system reduces the number of active servers to optimize utilization; when demand spikes, it increases capacity to maintain reliability. This parameter adjustment resolves the contradiction between maintaining service reliability and optimizing resource utilization
2Device complexity
If network farms maintain fixed server capacity, then device complexity is reduced, but adaptability deteriorates in response to changing demand patterns
Solution Approach 1:
The patent implements self-service automation where the network farm system autonomously monitors its own performance metrics, detects demand changes, and automatically provisions or deprovisions server capacity without manual intervention. This self-managing capability provides high adaptability to changing demand patterns while keeping operational complexity low, as the system handles its own capacity management through automated decision-making and execution
Data Source
AI summary
Dynamically upsizing and/or downsizing a network farm in response to network demand. An application message router routes messages to the network farm. When the network farm approaches or is anticipated to be approaching capacity, a group of one or more servers may be added to the network farm. When the added server(s) are capable of participating in the network farm, the application message router is triggered to route also to the added servers. When the network farm has excess capacity, a group of one or more servers may be dropped from the network farm. This may be accomplished by triggering the application message router to no longer route messages to the removed servers. The removed servers may be either immediately or gracefully removed from service.