Predicted Key Frame Synchronization for Video Streaming Latency
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video streaming technologies face challenges in reducing end-to-end latency, jitter, and maintaining high video quality due to network conditions, particularly exacerbated by the frequent transmission of large I-frames.
Innovation Solution
The introduction of a new frame type, predicted key frames (PK-frames), which are compressed using reference to a reference frame, and techniques for reference frame synchronization to reduce and potentially eliminate the transmission of I-frames during streaming.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If I-frames are transmitted frequently to maintain video quality and synchronization, then video quality and reliability are improved, but network bandwidth consumption increases and latency worsens
Solution Approach 1:
The patent extracts the essential function of I-frames (reference frame provision) and separates it from the full I-frame transmission. Instead of transmitting complete I-frames frequently, the system transmits only necessary reference frame data or uses previously decoded frames as references, reducing bandwidth consumption while maintaining video quality and synchronization.
Solution Approach 2:
The patent performs preliminary decoding and stores reference frames before they are needed for prediction. By pre-decoding and caching reference frames at the encoder side, the system prepares reference data in advance, eliminating the need for frequent I-frame transmissions and reducing network bandwidth usage while maintaining reliable video quality.
2Reliability
If I-frames are transmitted frequently to ensure frame synchronization, then reliability is improved, but end-to-end latency increases
Solution Approach 1:
The patent extracts the synchronization function from frequent I-frame transmissions and implements it through reference frame mechanisms. By using reference frames stored in buffers and predicting current frames from historical data, the system maintains frame synchronization without the latency overhead of frequent complete frame transmissions.
Solution Approach 2:
The patent performs preliminary decoding and buffering of reference frames before they are needed for prediction. This advance preparation ensures that reference frames are ready when needed for synchronization, eliminating waiting time and reducing end-to-end latency while maintaining reliable frame synchronization.
3Reliability
If I-frames are transmitted to maintain video quality, then video quality is improved, but jitter increases
Solution Approach 1:
The patent extracts the video quality maintenance function from frequent I-frame transmissions and implements it through reference frame prediction. By using stored reference frames and prediction algorithms, the system maintains consistent video quality without the network traffic variations and delays that cause jitter associated with frequent I-frame transmissions.
Solution Approach 2:
The patent performs preliminary decoding and caching of reference frames in advance, ensuring that reference data is readily available for prediction. This advance preparation stabilizes the encoding process by eliminating dependencies on timely I-frame arrivals, thereby reducing jitter while maintaining high video quality.
Data Source
AI summary
Methods of video streaming are generally described. In some examples, a camera device periodically captures an image, communicates encoded frame data representing that image to a server, and decodes and stores the previously encoded frame data as a background picture. The server receives the encoded frame data, decodes it, and stores the decoded frame in a buffer for future use. Subsequently, upon initiation of a streaming session, the camera device captures another image and encodes a predicted key frame based on differences between the captured image and the background picture. The camera device sends the predicted key frame to the server, which receives it and reconstructs a facsimile of the captured image utilizing the previously decoded frame stored in the buffer. Methods of acknowledging successfully decoded frames for use in selecting background pictures is also described.