Network Buffer Fill Control for Latency Management
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Large network buffers can lead to bufferbloat, causing significant latency issues in latency-critical services like videoconferencing and streaming media, especially when modern devices with large buffers are connected to slower links, as the buffer fills up without packet loss feedback, leading to unacceptably long wait times.
Innovation Solution
A method to monitor network latency and adjust network traffic scheduling parameters to set a maximum currently usable network speed lower than the maximum possible speed, preventing buffer overflow by managing the fill state of external network buffers without direct access, using latency observations to regulate data flow.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If large network buffers are used to compensate for varying network traffic loads, then network performance is improved, but network latency increases significantly when buffers fill up
Solution Approach 1:
The system monitors network latency as feedback from the network buffer state and uses this information to dynamically adjust the network send rate. When latency exceeds a threshold indicating buffer fill conditions, the system reduces the send rate to prevent further buffer accumulation, thus resolving the latency issue while maintaining optimal network performance during normal conditions
Solution Approach 2:
The network send rate is made dynamic rather than fixed, allowing it to adjust in real-time based on observed latency conditions. The system transitions between different operational states (normal rate vs. reduced rate) based on buffer fill indicators, enabling the network connection to adapt to changing buffer conditions and avoid sustained high latency
2Loss of time
If the network send rate is reduced to prevent buffer overflow, then network latency is reduced, but network throughput decreases
Solution Approach 1:
The system periodically monitors network latency and adjusts the send rate in periodic intervals rather than continuously reducing it. This allows the system to maintain high throughput during normal operating conditions while briefly reducing the rate only when and if buffer fill conditions occur, minimizing the impact on overall network productivity
Solution Approach 2:
The system changes the network send rate parameter dynamically based on latency observations. Rather than permanently reducing the rate, it adjusts the parameter temporarily when buffer fill is detected, then restores the original rate when conditions improve, thus maintaining high throughput capability while preventing latency issues
Data Source
AI summary
A method of managing a fill state of a buffer in an external device includes monitoring the latency of a network connection to an external device having a network buffer via a managing device. A state of fill of the network buffer is determined based on at least the monitored latency of the network connection, and the effective network speed is estimated based on the state of fill of the network buffer. One or more network traffic scheduling parameters are adjusted in response to the estimated effective network speed, such as a maximum currently usable network speed that is lower than a maximum possible speed of the network. The maximum currently usable network speed of the network connection is periodically increased if the monitored latency is in a normal state and the maximum currently usable network speed is lower than the maximum possible speed of the network.