Server Resource Throttling via Latency-Based Delay

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In modern server systems, resource contention leads to inefficiencies and vulnerabilities, such as denial-of-service attacks where malicious entities can monopolize resources, preventing legitimate clients from accessing them timely.

Innovation Solution

A computing device acts as a server that throttles resource access by calculating a delay period based on a client's recent latency level, delaying secondary requests to prevent monopolization and allow other clients to access resources efficiently.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If a client sends a large number of requests to access a resource, then the client can quickly access the resource when needed, but the client may monopolize the resource and prevent other clients from accessing it

Engineering Contradiction:
Improveresource access speedVSAvoidresource availability for other clients
Core Design Contradiction:
SpeedVSReliability

Solution Approach 1:

The patent implements periodic action by introducing delay periods between requests from the same client. The delay period is calculated based on the client's recent latency level, creating a rhythmic pattern of request throttling that prevents monopolization while allowing legitimate access. This periodic interruption ensures resource availability for other clients while maintaining service for the original client.

Inventive Principle:
Principle #19Periodic action

2Productivity

If the server processes all requests immediately, then system throughput is maximized, but malicious entities can launch denial of service attacks by sending大量 illegitimate requests

Engineering Contradiction:
Improvesystem throughputVSAvoiddenial of service attack vulnerability
Core Design Contradiction:
ProductivityVSObject-affected harmful factors

Solution Approach 1:

The patent introduces an intermediary mechanism (the first server acting as a gateway) that mediates between clients and the resource. This intermediary calculates delay periods and throttles requests before they reach the resource, filtering out potential denial of service attacks while allowing legitimate requests to pass through. The intermediary protects the resource without completely blocking productivity.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Reliability

If delay periods are imposed on all clients, then resource monopolization is prevented, but legitimate clients experience excessive delays

Engineering Contradiction:
Improveresource fairnessVSAvoidclient waiting time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent applies parameter changes by dynamically adjusting the delay period duration based on the client's recent latency level. Clients with normal latency experience shorter or no delays, while clients showing monopolization behavior experience longer delays. This adaptive parameter adjustment maintains resource fairness without imposing excessive delays on legitimate clients.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS8977677B2Throttling usage of resources
Publication Date: 2015.03.10 MICROSOFT TECHNOLOGY LICENSING LLC
  • US8977677B2 patent drawing
  • US8977677B2 patent drawing
  • US8977677B2 patent drawing

AI summary

A computing device provides a first server. The first server receives a primary request associated with a client. In response to receiving the primary request, the first server processes the primary request to generate a response message. As part of processing the primary request, the first server sends a secondary request to a second server after a delay period expires. The second server accesses a resource as part of processing of the secondary request. The duration of the delay period depends at least in part on a recent latency level of the client with regard to the resource. In this way, the first server throttles access to the resource.