Video I-Frame Segmentation for Adaptive Streaming Latency
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Adaptive bitrate streaming in video transmission faces challenges in reducing end-to-end latency and network congestion due to the large size and computational intensity of I-frames, which cause spikes in network traffic and inefficient data transmission.
Innovation Solution
The technique involves dividing full-quality I-frames into lower quality I-frames and enhancement layers, allowing for incremental quality improvement during reception, thereby reducing network traffic and latency by normalizing frame data sizes and optimizing transmission characteristics.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If full-quality I-frames are transmitted in adaptive bitrate streaming, then video quality is improved, but network congestion and latency increase due to large frame sizes
Solution Approach 1:
The patent divides full-quality I-frames into multiple quality layers: a base lower-quality I-frame and multiple enhancement layers. This segmentation allows the base frame to be transmitted first for immediate decoding and display, while enhancement layers are transmitted subsequently to progressively improve quality without increasing initial latency
Solution Approach 2:
The patent transmits the lower-quality base I-frame in advance before the full-quality version is complete. This preliminary action enables early video playback and reduces perceived latency, while enhancement layers are sent beforehand to allow progressive quality improvement once received
2Measurement precision
If full-quality I-frames are transmitted in adaptive bitrate streaming, then video quality is improved, but network traffic spikes and congestion occur
Solution Approach 1:
The patent segments full-quality I-frames into a smaller base layer and multiple enhancement layers. This segmentation distributes the total data quantity across multiple smaller packets transmitted at different times, preventing network traffic spikes that would occur with single large I-frame transmissions
Solution Approach 2:
The patent enables dynamic quality adaptation by transmitting enhancement layers conditionally based on network conditions. When network bandwidth is limited, only the base layer is transmitted; when bandwidth is available, enhancement layers are added progressively, allowing flexible traffic management
3Measurement precision
If full-quality I-frames are transmitted, then reference frame quality is improved, but computational resource usage increases
Solution Approach 1:
The patent segments reference frame quality into a decodable base layer and enhancement layers. The decoder only needs to process the base layer for immediate video playback, consuming minimal computational resources, while enhancement layers are processed optionally to improve reference frame quality when computational resources are available
Data Source
AI summary
Methods of video streaming are generally described. In some examples, the methods may be performed by a server device and may include generating first intra-coded frame (I-frame) data and a plurality of enhancement layer data corresponding to the first I-frame data. The methods may further include sending the first I-frame data to a client device. The methods may further include transmitting first enhancement layer data to the client device. The methods may include sending first inter-coded frame data to the client device. In some examples, the first inter-coded frame data can be decoded by referencing first reference frame data generated by combining the first I-frame data and the first enhancement layer data.