Predictive Jitter Buffer Adaptation for Smooth Live Video Streaming
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional real-time live video streaming systems fail to accurately and reliably adapt jitter buffer delay under constrained and lossy network conditions, leading to quality degradation and freezing, which hinders the deployment of delay-sensitive interactive applications.
Innovation Solution
Implement a Kalman filter-based predictive jitter buffer adaptation mechanism that reconstructs video frames using metadata, computes one-way delay and gradient, and predicts future delays to maintain smooth streaming through adaptive jitter buffer adjustments.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If conventional jitter buffer adaptation methods are used, then the system is simple to implement, but the accuracy and reliability of delay adaptation is insufficient leading to quality degradation and freezing
Solution Approach 1:
The patent implements a feedback mechanism where the Kalman filter continuously monitors reception parameters (packet arrival times, delays) and adjusts jitter buffer settings based on predicted delay gradients. This closed-loop feedback system improves adaptation reliability by dynamically responding to network conditions rather than using static or simple adaptive methods.
Solution Approach 2:
The patent replaces conventional mechanical/judgment-based jitter buffer adaptation with a mathematical prediction model (Kalman filter). Instead of using simple threshold-based or heuristic methods, the system uses statistical estimation theory to predict future delay gradients, thereby improving reliability through more accurate mathematical modeling of network behavior.
2Loss of time
If the jitter buffer delay is reduced to improve responsiveness, then latency is reduced, but video smoothness and reliability under lossy network conditions deteriorate
Solution Approach 1:
The patent performs preliminary action by predicting the delay gradient for incoming frames before they arrive. The Kalman filter estimates future delay characteristics based on historical data, allowing the system to proactively adjust the jitter buffer settings in advance. This predictive approach enables optimal buffer configuration that balances latency reduction with smoothness maintenance.
Solution Approach 2:
The patent implements dynamic jitter buffer adaptation where the buffer delay is continuously adjusted based on real-time network conditions and predicted delay gradients. Rather than using a fixed or statically configured buffer, the system dynamically modifies buffer parameters to optimize the trade-off between latency and smoothness under varying network conditions.
3Measurement precision
If conventional approaches are used to adapt jitter buffer, then implementation is straightforward, but accuracy of delay prediction is insufficient
Solution Approach 1:
The patent replaces simple measurement or estimation methods with the Kalman filter, a sophisticated mathematical prediction algorithm. This substitution significantly improves measurement precision of delay gradients by using optimal estimation theory that accounts for process noise and measurement noise, providing more accurate predictions than conventional approaches.
Solution Approach 2:
The patent introduces the Kalman filter as an intermediary layer between raw reception parameter measurements and jitter buffer control decisions. This intermediary processing layer enhances prediction accuracy by filtering noise, estimating state variables, and providing refined delay gradient predictions that improve overall system performance despite added computational complexity.
Data Source
AI summary
This disclosure provides a Kalman filter based predictive jitter buffer adaptation for smooth live video streaming. In the present disclosure, at receiver of a live video steaming system, reassembly of received data packets is performed to reconstruct different types of encoded frames transmitted by a transmitter. The different types of encoded frames are Full encoded frames in basic state and Delta encoded frames. To tackle data packet loss, the receiver is also equipped with a frugal yet efficient loss handling mechanism for both basic and delta frames. To achieve smooth rendering of the live video, the receiver employs a Kalman Filter based Jitter Buffer Adaptation mechanism. The Kalman Filter based Jitter Buffer Adaptation mechanism observes variability in arrival time of the open-loop best-effort traffic and adapts a jitter-buffer based on future end-to-end delay estimates. Thus, smoothness of streaming is preserved at the receiving end augmented with robust loss-resilience.