Variable Delay Resource Control for Bursty Traffic
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing communication systems face challenges in handling bursty traffic and maintaining low latency, as current models either lead to excessive hardware usage or introduce unnecessary delays due to fixed intervals and thread management inefficiencies.
Innovation Solution
An apparatus and method that dynamically control the use of execution resources based on operating conditions, using a variable delay to switch between asynchronous and sporadic modes, preventing overloading and optimizing resource allocation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Stability of the object's composition
If fixed interval handling is used to manage bursty traffic, then system stability is improved, but response time increases and throughput decreases
Solution Approach 1:
The patent applies dynamics by making the handling interval variable rather than fixed. The system dynamically adjusts the interval between handling operations based on the current system load and queue depth. When the system is under light load, handling occurs more frequently to reduce response time. When the system is under heavy load, the interval increases to prevent overload and maintain stability. This dynamic adjustment resolves the contradiction between stability and response time.
Solution Approach 2:
The patent changes the parameter of handling interval from a fixed constant to a variable parameter that adapts to system conditions. By monitoring system load and adjusting the handling interval accordingly, the system can optimize both stability and response time. The handling interval becomes a controllable parameter that can be increased or decreased based on real-time system state, allowing the system to maintain stability during bursts while minimizing response time delays.
2Productivity
If maximum throughput capacity is increased to handle bursts, then productivity is improved, but device complexity and hardware costs increase
Solution Approach 1:
The patent applies dynamics by enabling the system to adapt its throughput capacity dynamically through software-controlled interval adjustment rather than requiring fixed hardware over-provisioning. The system can handle bursts by temporarily increasing handling frequency when needed, without requiring permanent hardware upgrades. This resolves the contradiction by providing high throughput capacity on-demand while maintaining simple hardware architecture.
Solution Approach 2:
The patent changes the throughput capacity parameter from a fixed hardware-determined value to a software-controllable variable. By adjusting the handling interval parameter, the system can dynamically modify its effective throughput capacity to match actual demand. This eliminates the need for complex hardware designed for maximum theoretical throughput, reducing device complexity while maintaining productivity when needed.
3Loss of time
If asynchronous handling with thread pools is used, then response time is improved, but system reliability decreases during bursts due to thread exhaustion
Solution Approach 1:
The patent applies preliminary action by proactively controlling the handling interval before thread exhaustion occurs. Instead of waiting for threads to be exhausted and then failing, the system monitors system load and adjusts the handling interval in advance to prevent thread pool exhaustion. This preliminary control maintains both fast response times and system reliability by avoiding the brittle all-or-nothing behavior of fixed thread pools during bursts.
Data Source
AI summary
An application executing apparatus including at least one execution resource configured to execute at least one application is disclosed. The apparatus is provided with at least one processor configured to detect events triggering execution of the at least one application and to dynamically control use of the at least one execution resource in handling of the detected events based on a variable reflective of the operating conditions of the apparatus.