Client-Based Overload Control for Server Rate Adaptation

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing communication systems face instability and reduced throughput during server overloads due to high demand, leading to congestion collapse and increased latency, as receiver-based overload control mechanisms require significant processing burden and protocol changes, which are inefficient and difficult to implement.

Innovation Solution

Implementing client-based overload control by determining an overload value based on explicit or implicit criteria and adjusting transmission rates to limit server load, thereby reducing the burden on servers and maintaining high throughput during overloads without requiring changes to the protocol stack.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If receiver-based overload control mechanisms are implemented, then server overload protection is improved, but processing burden on server increases and protocol changes are required

Engineering Contradiction:

Improveserver overload protectionVSAvoidprocessing burden on server

Core Design Contradiction:

ReliabilityVSDevice complexity

Solution Approach 1:

The patent inverts the traditional receiver-based overload control approach by implementing sender-based overload control. Instead of having the server (receiver) actively manage overload conditions, the client (sender) monitors server response times and proactively adjusts its request transmission rate. This inversion shifts the control burden from server to client, resolving the contradiction by maintaining reliability through client-side adaptation while reducing server processing complexity.

Inventive Principle:

Principle #13The other way round (Inversion)

Solution Approach 2:

The system enables self-service overload control where each client independently monitors server response performance and autonomously adjusts its own transmission rate without requiring server intervention or protocol modifications. The client serves itself by detecting overload conditions through response time measurements and automatically throttling its request rate, eliminating the need for complex server-side overload management mechanisms.

Inventive Principle:

Principle #25Self-service

2Reliability

If receiver-based overload control mechanisms are implemented, then server overload protection is improved, but protocol changes are required

Engineering Contradiction:

Improveserver overload protectionVSAvoidprotocol implementation complexity

Core Design Contradiction:

ReliabilityVSEase of manufacture

Solution Approach 1:

The client independently performs overload detection and control using existing protocol mechanisms, specifically by measuring response times of received responses. This self-service approach eliminates the need for new protocol elements, overload feedback messages, or distribution list management, as the client autonomously adapts its behavior based on observed server performance without requiring protocol stack modifications.

Inventive Principle:

Principle #25Self-service

Solution Approach 2:

The system changes the behavioral parameter of the client (transmission rate) rather than modifying protocol parameters. By dynamically adjusting the request transmission rate based on measured response times, the system achieves overload protection through parameter adaptation of existing protocol operations, avoiding the need for protocol changes while maintaining reliability.

Inventive Principle:

Principle #35Parameter changes

3Reliability

If server maintains distribution list for receiver-based control, then overload control is improved, but processing burden on server increases

Engineering Contradiction:

Improveoverload control effectivenessVSAvoidserver processing capacity

Core Design Contradiction:

ReliabilityVSProductivity

Solution Approach 1:

The patent extracts the overload control functionality from the server and relocates it to the client. By removing the distribution list maintenance and overload message distribution tasks from the server, the system eliminates the processing burden associated with these operations. The client independently performs overload detection and rate adjustment, allowing the server to focus solely on request processing without the overhead of active overload management.

Inventive Principle:

Principle #2Taking out (Extraction)

Solution Approach 2:

Each client independently monitors server response times and autonomously adjusts its transmission rate without requiring server coordination or distribution list management. This self-service mechanism eliminates the need for the server to maintain client state information or distribute control messages, preserving server processing capacity for actual request handling while maintaining effective overload control.

Inventive Principle:

Principle #25Self-service

Data Source

PatentUS8699343B2Adaptive rate control based on overload signals

Publication Date: 2014.04.15 RIBBON COMMUNICATIONS OPERATING CO INC

AI summary

Described are methods and apparatuses, including computer program products, for limiting server overload via client control. A first set of a plurality of requests are transmitted to a server at a first transmission rate during a first period of time. The first transmission rate is limited to be less than or equal to a first transmission limit rate. An overload value is determined based on whether at least two or more requests of the first set of requests for service satisfy an overload criterion. A second transmission limit rate is determined based on the overload value and the first transmission limit rate. A second set of a plurality of requests is transmitted to the server at a second transmission rate during a second period of time. The second transmission rate is limited to be less than or equal to the second transmission limit rate.