Workload Regulator for Multi-Tenant Anomaly Mitigation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In multi-tenant web applications, unusual workload spikes from individual actors can disrupt shared resources, leading to performance issues and potential anomalies such as DOS attacks, which existing load balancing technologies fail to address effectively.
Innovation Solution
A workload regulator is implemented at the edge of the system to dynamically manage incoming requests through a set of extensible rules and actions, including request filtering, routing, throttling, and isolation, based on real-time and historical metrics, to mitigate anomalies and manage resource usage.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If load balancing technologies are used to distribute requests, then resource utilization is improved, but anomaly mitigation and workload shaping capabilities are insufficient
Solution Approach 1:
The patent segments the request handling process into multiple independent components: a workload regulator that shapes incoming requests, a request router that directs traffic, and anomaly detectors that monitor system state. This segmentation allows each component to specialize in specific functions, enabling both efficient resource utilization and effective anomaly mitigation simultaneously.
Solution Approach 2:
The patent introduces a workload regulator as an intermediary component between external request sources and the application servers. This regulator acts as a mediator that can buffer, shape, and control the flow of requests before they reach the backend systems, thereby preventing anomalies while maintaining high resource utilization through controlled load distribution.
2Productivity
If shared resources are used in multi-tenant environment, then resource efficiency is improved, but vulnerability to workload spikes and DOS attacks increases
Solution Approach 1:
The patent implements beforehand cushioning by introducing a workload regulator that maintains request queues and buffers incoming traffic before it reaches shared resources. This cushioning mechanism absorbs workload spikes and prevents them from directly impacting the shared infrastructure, thereby protecting against DOS attacks while maintaining resource efficiency during normal operation.
Solution Approach 2:
The patent applies local quality by implementing tenant-specific isolation and customization within the shared resource environment. Each tenant can have customized rate limits, priority levels, and isolation policies applied locally, allowing the system to maintain high overall resource efficiency while providing targeted protection against workload spikes from individual tenants.
3Adaptability or versatility
If dynamic workload management is implemented, then system adaptability is improved, but complexity of request handling increases
Solution Approach 1:
The patent implements universality by designing a workload regulator that performs multiple functions through a single unified architecture. The regulator simultaneously handles request buffering, shaping, routing, anomaly detection, and tenant isolation, thereby achieving high system adaptability without proportionally increasing complexity. This multi-functional approach consolidates what would otherwise require multiple separate systems.
Data Source
AI summary
Techniques and mechanisms for servicing requests for utilization of resources within a computing environment. A request is received from a remote electronic computing device with a regulator agent. The regulator functions to determine whether to regulate a request or to allow the request to be delivered without regulation. Regulating the request includes causing the request to be rejected, re-routed, isolated or delayed. Selectively regulating the request with the regulator based at least on application-level resources to be utilized by the application server in response to the request. Sending the request to a regulation server or to a computing device to provide an application server communicatively coupled with the regulator server depending on the regulation to be performed, if any.