Directory-Based Web Service Distributor for Dynamic Load Balancing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current web service distribution systems are limited by the number of rules or policies they can support, making it difficult to partition state effectively across multiple pods, and they lack dynamic updating capabilities, leading to management burdens and inefficiencies in scaling and load distribution.
Innovation Solution
A web service invocation framework with an integrated directory-based distributor that uses a directory to dynamically direct requests to the appropriate pod based on lookup values extracted from the request, allowing for flexible partitioning of state and efficient load distribution across multiple pods.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If content-based load distribution with rules or policies is used, then requests can be distributed to pods, but the number of partitioned pods is limited because each pod requires at least one rule or policy
Solution Approach 1:
The patent introduces a directory service as an intermediary component that stores the mapping between partition keys (such as asset IDs) and pod identifiers. Instead of embedding distribution rules directly in the load balancer, the system uses the directory service to externalize and centralize the distribution logic. This allows an unlimited number of partitions to be managed through simple key-lookups rather than requiring proportional rules or policies in the load balancer itself.
2Adaptability or versatility
If rules and policies are configured into the load distributor, then load distribution can be controlled, but the system cannot be dynamically updated when assets are added, removed, or when pods are changed
Solution Approach 1:
The system implements dynamic configuration by storing distribution mappings in a directory service that can be updated in real-time. When new assets are added, removed, or when pod configurations change, the directory service is updated accordingly without requiring system restarts or complex reconfiguration procedures. The load balancer simply performs lookups against the updated directory, enabling seamless dynamic adaptation to changing system conditions.
3Adaptability or versatility
If multiple instances of load distributors are deployed across multiple sites, then geographically distributed web services can be supported, but each instance requires independent configuration using proprietary interfaces
Solution Approach 1:
The patent implements a universal directory service interface that can be accessed by multiple load distributor instances across different geographic locations. The directory service provides a standardized mechanism for storing and retrieving distribution mappings, eliminating the need for each instance to be configured with proprietary interfaces. This universal interface allows centralized management of distribution logic that serves multiple distributed instances, reducing configuration complexity and enabling easier replication across sites.
Data Source
AI summary
In one embodiment, an apparatus for directory-based web service distribution is disclosed. The apparatus includes a directory and a request client to initiate a request for a web service, the request client including an application middleware having invocation framework with embedded distribution logic to distribute the request to a destination pod, the destination pod to compute a subset of a state associated with the web service, wherein the distribution logic to distribute the request based on a lookup value extracted from the request and submitted to the directory to determine the destination pod. Other embodiments are also disclosed.