Server Farm Power Savings via Threshold-Based Load Balancing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Server farms face high power consumption and heat-related issues due to the constant operation of numerous servers, leading to increased costs, reduced device lifespan, and infrastructure demands, despite existing power management technologies and load balancing schemes.
Innovation Solution
Implementing a threshold-based approach where servers are categorized into active and standby states, with tasks assigned based on connection thresholds, allowing servers to transition between states to optimize power usage and maintain efficient load balancing.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If servers operate constantly to maintain connection efficiency and respond quickly to requests, then service response time is improved, but power consumption increases
Solution Approach 1:
The system dynamically adjusts server operational states based on real-time load conditions. Servers transition between active, standby, and powered-off states depending on whether the farm is operating below, at, or above connection thresholds, allowing the system to adapt power consumption to actual service demands
Solution Approach 2:
The system maintains a pool of standby servers that are pre-positioned and ready to activate quickly when load increases. This preliminary preparation of standby resources enables fast response to sudden traffic spikes without requiring all servers to remain continuously powered on
2Productivity
If more servers are deployed to handle enterprise application demands, then productivity is improved, but power consumption and heat generation increase
Solution Approach 1:
The server farm is segmented into distinct operational pools: active servers handling current load, standby servers ready for rapid activation, and powered-off servers conserving energy. This segmentation allows the system to maintain large deployment capacity while only powering sufficient servers for current demands
Solution Approach 2:
The system changes the operational parameter of server power states based on farm utilization. By adjusting the number of active versus standby servers according to connection thresholds, the system optimizes the balance between handling capacity and power consumption
3Reliability
If servers remain in active state to ensure quick response, then service availability is improved, but device lifespan is reduced due to increased heat and wear
Solution Approach 1:
Servers undergo periodic state changes between active, standby, and powered-off modes based on fluctuating load conditions. This periodic cycling reduces continuous operational wear and heat exposure while maintaining service availability through the standby pool
Solution Approach 2:
The standby server pool acts as a cushion that can be activated beforehand to handle sudden load increases, protecting active servers from continuous high-stress operation and thereby extending their operational lifespan
Data Source
AI summary
A threshold-based approach is used to assign tasks to servers in a server farm. A “number of connections” count or “connection rate” is maintained for an active server and when the count achieves a first value a wake up signal is sent to a next (inactive) server to alert the inactive server to become active and periodic keep alive signals are initiated. When the number of connections next reaches a second, higher value, subsequent requests for connections are sent to the newly active server. Variations of this approach allow for servers and their associated processes and devices to be handled in clusters for power management scaling efficiency. Servers can be placed in the inactive mode when the number of connections reaches a lower threshold. Other criteria can be used to determine activation of servers, processors or other devices or processes. Other types of resource use monitoring can also be used with this invention.