Video Stream Encoding With Sliding Reference Windows for Lossy Networks
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Inter-frame prediction in video compression induces frame dependency, leading to errors propagating across frames and requiring significant storage and delay in recovery mechanisms, causing video stutter or corruption.
Innovation Solution
Implement a dynamic sliding frame window to enforce a minimum distance between inter-frames and reference frames, encoding video streams as interleaved sub-streams to spread errors temporally and reduce dependency, allowing for adaptive error resilience.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of energy
If inter-frame prediction is used to reduce data consumption, then bandwidth efficiency is improved, but error propagation between frames increases
Solution Approach 1:
The video stream is segmented into multiple independent reference chains, where each chain uses its own reference frames. This segmentation isolates error propagation to individual chains, preventing errors from spreading across the entire video stream while maintaining inter-frame prediction benefits within each chain.
Solution Approach 2:
The patent dynamically adjusts the reference frame distance parameter (L0) based on network conditions. When packet loss is detected, L0 is increased to reduce dependency on potentially corrupted reference frames. This parameter change allows the system to adaptively balance compression efficiency with error resilience.
2Loss of energy
If reference frames are stored to enable inter-frame prediction, then compression efficiency is improved, but storage capacity requirements increase
Solution Approach 1:
Instead of storing all reference frames in a single large buffer, the patent divides reference frames into multiple separate chains, each with its own smaller buffer. This segmentation reduces the peak storage requirement at any given time while maintaining the ability to perform inter-frame prediction within each chain.
Solution Approach 2:
The patent implements a sliding window mechanism that discards older reference frames once they have been used for prediction and replaced by newer frames. This allows the system to maintain only the necessary reference frames in memory, reducing storage requirements while preserving compression efficiency.
3Loss of energy
If frame dependency is enforced for compression, then data reduction is improved, but error recovery delay increases
Solution Approach 1:
By segmenting the video stream into independent reference chains, the patent limits error propagation to only the affected chain. Other chains continue decoding without interruption, significantly reducing the overall error recovery delay compared to a single dependent chain where errors would propagate through all subsequent frames.
Solution Approach 2:
The patent uses partial inter-frame prediction by allowing some frames to be encoded as intra-frames (I-frames) rather than purely inter-frames. This partial action breaks the dependency chain at strategic points, enabling faster error recovery while maintaining compression efficiency for frames that can safely use inter-frame prediction.
Data Source
AI summary
In various examples, systems, devices and methods are disclosed relating to enhancing the efficiency and reducing the delay of error resilience in multimedia communication systems. The systems, devices and methods can include a computer system determining a sliding frame window (or a sliding reference window) for a video stream. The size of the sliding frame window represents a minimum separation between reference frames and corresponding inter frames. The computer system can encode a plurality of video frames of the video stream according to the size of the sliding frame window, such that a separation between any pair of video frames of the plurality of video frames including a reference frame and a corresponding inter-frame is greater than or equal to the size of the sliding frame window.