Virtual Clustering Load Balancing Servers
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current network systems lack intelligent dispatching capabilities to efficiently balance load across servers in open clusters, leading to server overload and inefficiencies, as they do not monitor server capacity or adjust query routing dynamically based on demand or user priority.
Innovation Solution
The system organizes servers into virtual clusters and uses an intelligent network dispatcher to monitor performance statistics, redirect requests, and reassign servers based on workload capacity and predefined criteria, providing differentiated service grades and authentication for requesters.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If round robin dispatching is used to distribute requests, then requests are distributed across servers, but server overload occurs and other servers remain idle
Solution Approach 1:
The system dynamically adjusts server assignments based on real-time workload monitoring. Servers are assigned to different virtual clusters depending on their current load status, allowing the system to adapt to changing conditions and prevent static round-robin overload problems
Solution Approach 2:
The system continuously monitors server workload capacity and uses this feedback to make intelligent routing decisions. When a server is detected as overloaded, the system redirects requests to less burdened servers, creating a closed-loop control mechanism that prevents server overload
2Reliability
If servers are kept available for peak load periods, then service capacity is maintained, but resource waste occurs during normal periods
Solution Approach 1:
The system dynamically reassigns servers between virtual clusters based on real-time demand. During peak periods, servers are allocated to handle increased load, while during normal periods, servers can be reassigned to different functions or put into lower-power states, optimizing resource utilization while maintaining availability when needed
3Device complexity
If server assignments are fixed, then system configuration is simple, but load balancing efficiency is poor
Solution Approach 1:
The system segments servers into multiple virtual clusters that can be independently managed and assigned to different request types. This segmentation allows for flexible load distribution while maintaining manageable configuration through predefined cluster rules
Solution Approach 2:
The system transitions from static server assignments to dynamic reassignment based on monitored workload capacity. Servers can be moved between virtual clusters in response to changing conditions, significantly improving load balancing efficiency without requiring complex manual reconfiguration
Data Source
AI summary
A method and system is provided intelligent network dispatchers that are capable of routing requests to one or more servers (e.g., LDAP servers) based on the requested application or the identity of the requester. The servers may be grouped into virtual clusters so that a particular cluster may service requests associated with a particular application or based on a type of customer (e.g., preferred or general customer) in order to grade levels of service. Also, a system resource monitor may provide continual monitoring of servers in virtual clusters to determine when one or more servers are overburdened or under burdened based on statistical performance data. As a servers performance changes, the system resource monitor may advise the intelligent network dispatcher causing a change in the rate of requests to the overburdened/under burdened server. The server may be temporarily removed from the virtual cluster until performance levels normalize. Further, servers may be re-assigned to other virtual clusters on demand to provide increased capacity to a virtual cluster.