Layered Video Encoding for High Frame Rate Processing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Traditional video codecs are unable to provide smooth user experiences at high frame rates due to their application to entire frames of a video stream, leading to inefficiencies in encoding and decoding processes.
Innovation Solution
The implementation of layered screen video coding and decoding, where video frames are analyzed to determine differences, allowing for base layer and second layer encoding, enabling efficient transmission and decoding of only necessary regions, thereby supporting high frame rates.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If traditional video codecs are applied to entire frames, then encoding completeness is maintained, but frame rate and processing efficiency deteriorate
Solution Approach 1:
The patent divides a video frame into multiple layers: a base layer containing common content shared across multiple frames, and multiple enhancement layers containing frame-specific differences. This segmentation allows the base layer to be encoded once and reused, while only the smaller enhancement layers need to be encoded at full frame rate, thereby increasing overall frame rate while reducing coding complexity.
Solution Approach 2:
The patent extracts and separates the common content present across multiple consecutive frames into a base layer, leaving only the unique differences in enhancement layers. By taking out the redundant common information, the system reduces the amount of data that needs to be processed at high frame rates, improving productivity while managing complexity.
2Quantity of substance
If traditional video codecs encode entire frames, then complete video information is transmitted, but data transmission efficiency and bandwidth utilization worsen
Solution Approach 1:
The patent merges common content from multiple frames into a single base layer that is transmitted once, and combines this with smaller enhancement layers containing frame-specific data. This merging reduces the total data transmission volume while maintaining complete video information, thereby improving transmission efficiency and bandwidth utilization.
Solution Approach 2:
The patent introduces a temporal dimension to the encoding structure by creating layers that span multiple frames in time. The base layer represents temporal redundancy across frames, while enhancement layers capture temporal differences. This dimensional approach reduces data volume by exploiting temporal correlations, improving transmission efficiency.
3Loss of time
If traditional video codecs process complete frames, then decoding accuracy is maintained, but processing time and computational load increase
Solution Approach 1:
The patent performs preliminary encoding of the base layer containing common content that can be decoded once and reused across multiple frames. This preliminary action reduces the computational load for each subsequent frame, decreasing processing time while maintaining decoding accuracy through the combination of base and enhancement layers.
Solution Approach 2:
The patent applies different encoding qualities to different parts of the frame by using a base layer for common content and enhancement layers for frame-specific details. This local quality approach allows faster decoding of the base layer while preserving accuracy in the enhancement layers, optimizing the balance between processing time and decoding accuracy.
Data Source
AI summary
In some examples, a layered encoding component and a layered decoding component provide for different ways to encode and decode, respectively, video streams transmitted between devices. For instance, in encoding a video stream, a layered encoding component may analyze the content of successive video frames and determine different types of encoding techniques to use for different ones of the video frames. Further, in some cases, some of the encoding techniques may be used on less than an entire video frame. In another example, in decoding a video stream, a layered decoding component may receive video frames encoded with different types of encoding. The layered decoding component may decode the differently encoded video frames and combine them to reconstruct a video stream.