Client Device Decode Delay Reduction via Dynamic Buffer Rate
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Client devices experience decode delay when transitioning from real-time to buffered content presentation mode due to the need to accumulate a sufficient number of video frames, leading to stalled video and a poor user experience.
Innovation Solution
Transmitting video frames at a higher initial rate until the client device's buffer stores enough bits to start decoding, then reducing the transmission rate once the decode threshold is met, allowing for quicker accumulation of required frames and minimizing delay.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of time
If video frames are transmitted at a standard rate to the client device, then network bandwidth is conserved and energy is used efficiently, but the client device experiences decode delay when transitioning to buffered content presentation mode
Solution Approach 1:
The system dynamically adjusts the transmission rate based on the content presentation mode. When the client device is in real-time mode, video frames are transmitted at a first transmission rate. When switched to buffered mode, the transmission rate is increased to a second rate to quickly fill the buffer, then reduced to a third rate once the decode threshold is met. This dynamic adjustment resolves the contradiction by adapting bandwidth usage to the specific operational context.
Solution Approach 2:
The patent changes the transmission rate parameter in response to mode transitions and buffer status. The transmission rate is changed from a first rate to a second rate when transitioning to buffered mode, and then to a third rate when the decode threshold is satisfied. This parameter change allows the system to prioritize decode delay reduction during mode transitions while conserving bandwidth during stable operation.
2Speed
If video frames are transmitted at a higher rate to reduce decode delay, then the client device can quickly accumulate buffer content, but network bandwidth is consumed more rapidly
Solution Approach 1:
The system employs periodic rate adjustment: initially transmitting at a higher second rate to quickly accumulate buffer content, then switching to a lower third rate once the decode threshold is satisfied. This periodic action pattern allows rapid buffer filling when needed while conserving bandwidth during sustained transmission, resolving the contradiction between speed and energy consumption.
Solution Approach 2:
The system performs preliminary high-rate transmission to quickly fill the buffer when transitioning to buffered mode, ensuring the decode threshold is met rapidly. After this preliminary action, the rate is reduced to a lower third rate for sustained transmission. This preliminary high-rate action resolves the contradiction by concentrating bandwidth consumption only when necessary for mode transition.
3Stability of the object's composition
If the client device waits for the buffer to accumulate sufficient video frames before presenting content, then decoding stability is improved, but user experience deteriorates due to stalled video during mode transitions
Solution Approach 1:
The system dynamically adjusts the transmission rate based on the content presentation mode and buffer status. When transitioning to buffered mode, the rate increases to a second rate to quickly provide sufficient frames for stable decoding. Once the decode threshold is met, the rate adjusts to a third rate. This dynamic adjustment maintains decoding stability while minimizing user-perceived delays during mode transitions.
Solution Approach 2:
The system uses feedback from the buffer status (whether the decode threshold is met) to adjust the transmission rate. When the decode threshold is not met during buffered mode, the system maintains a higher transmission rate. Once the threshold is satisfied, it reduces the rate. This feedback mechanism ensures decoding stability is maintained while optimizing user experience by reducing unnecessary delays.
Data Source
AI summary
Various implementations disclosed herein include devices, systems, and methods for reducing a decode delay at a client device. In some implementations, a device includes one or more processors and a non-transitory memory. In some implementations, a method includes determining that a client device is being switched from a real-time content presentation mode in which the client device presents real-time content to a buffered content presentation mode in which the client device presents buffered content. In some implementations, the method includes transmitting, to the client device, video frames corresponding to the buffered content at a first transmission rate. In some implementations, the method includes changing the first transmission rate to a second transmission rate based on an indication that a number of bits stored in a buffer of the client device satisfies a decode threshold.


