User Allocation System for Server Cluster Load Balancing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Large commercial internet-based businesses face challenges in maintaining consistent and reliable server systems that can handle millions of clients concurrently, requiring efficient load balancing and fail-safe mechanisms to ensure 24/7 operation across multiple server clusters.
Innovation Solution
The implementation of a system that allocates users to server clusters based on geographic location and resource availability, using a two-stage allocation process with allocation rules and heuristics for efficient load distribution, and periodic load re-balancing to maintain even workloads across clusters.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If users are allocated to server clusters without load balancing, then simple allocation is achieved, but server overload and service inconsistency occur
Solution Approach 1:
The system segments user allocation into two distinct stages: initial allocation to any available server cluster, and subsequent load-based rebalancing to optimal clusters. This segmentation allows the system to maintain simple initial allocation while adding complexity only where needed for load balancing, resolving the contradiction between reliability and device complexity.
Solution Approach 2:
The patent implements dynamic load balancing by continuously monitoring server cluster workloads and redistributing users based on real-time conditions. The system transitions from static initial allocation to dynamic rebalancing, ensuring service consistency while adapting to changing server capacities and user distributions.
2Productivity
If server systems handle millions of concurrent clients, then service capacity is improved, but system reliability deteriorates due to component failures
Solution Approach 1:
The patent prepares for potential server failures by implementing load balancing and redistribution mechanisms in advance. When servers are operational, the system maintains balanced workloads and prepares rebalancing capabilities, so that when failures occur, users can be quickly redistributed to healthy servers, maintaining system availability despite the stress of handling millions of concurrent clients.
3Productivity
If users are distributed across multiple server clusters, then load balancing is improved, but user allocation complexity increases
Solution Approach 1:
The allocation process is divided into two segmented phases: initial user allocation to any available cluster using simple criteria, and subsequent load-based rebalancing using complex monitoring and redistribution algorithms. This segmentation allows the system to achieve efficient load distribution while managing allocation complexity through staged processing.
Solution Approach 2:
The system performs preliminary user allocation to server clusters before implementing load-based rebalancing. This preliminary action establishes a baseline distribution that can be subsequently optimized without requiring complete reallocation, thereby improving load distribution efficiency while limiting the complexity of the allocation process to manageable stages.
4Reliability
If server systems operate 24/7 to serve global customers, then service availability is improved, but component failure risk increases
Solution Approach 1:
The patent implements load balancing and server redundancy mechanisms in advance to cushion against component failures. By maintaining balanced workloads across multiple server clusters and preparing redistribution capabilities, the system ensures that when components fail during 24/7 operation, the impact is minimized and service availability is maintained.
Solution Approach 2:
The system dynamically adapts to component failures by continuously monitoring server health and redistributing users from failed servers to operational ones. This dynamic response allows the system to maintain 24/7 service availability despite the increased component failure risk inherent in continuous global operation.
Data Source
AI summary
Providers of Internet based services must handle requests from many different customers. However, to make the experience simple and effective, a system for allowing a user to enter a simple Uniform Resource Locator based upon the user's identifier is provided that re-directs the user to a server cluster allocated to that user. The system is capable of periodic load re-balancing and can handle many different types of services for each user.


