Video Decoder Temporal Buffering for Scalable Quality Reconstruction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video coding systems face challenges in efficiently processing scalable encoding, particularly in terms of encoder and decoder efficiency, which affects performance and the ability to recover high-quality video signals.
Innovation Solution
A hybrid backward-compatible coding technology that combines a base codec with two enhancement levels, utilizing down-sampling, correction, and enhancement data streams to create a flexible and adaptable coding format suitable for various applications, including OTT transmission and live UHD broadcast.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If scalable encoding techniques are used to enable reconstruction at different quality levels, then signal quality and adaptability are improved, but encoder and decoder processing efficiency deteriorates
Solution Approach 1:
The patent segments the video signal into multiple enhancement layers (first enhancement layer and second enhancement layer) with different quality levels. Each layer can be independently processed and decoded, allowing the decoder to reconstruct the signal at different quality levels by selectively decoding only the necessary layers, thereby improving processing efficiency while maintaining adaptability.
Solution Approach 2:
The patent implements partial action by allowing decoders to process only the enhancement layers they require. A decoder can choose to decode only the base layer for lower quality reconstruction, or add the first enhancement layer for medium quality, or both enhancement layers for high quality reconstruction. This partial processing approach significantly reduces the computational burden compared to processing all layers regardless of requirement.
2Manufacturing precision
If multiple enhancement levels are combined with base codec to improve visual quality, then signal quality is improved, but system complexity increases
Solution Approach 1:
The patent employs a nested structure where the first enhancement layer is embedded within the second enhancement layer, and both are nested within the base codec framework. This nested organization allows for systematic processing where each layer builds upon the previous one, managing complexity through hierarchical structuring while achieving progressive quality enhancement.
Solution Approach 2:
The patent divides the enhancement process into distinct segmented layers (first enhancement layer and second enhancement layer), each with its own encoding and decoding procedures. This segmentation allows each layer to be processed independently using standardized techniques, preventing the system from becoming unwieldy despite multiple quality levels, as each segment follows consistent processing rules.
Data Source
AI summary
A decoder (400) configured to receive a first output video and one or more further encoded streams (416, 428), decode respective frames of the one or more further encoded streams to derive respective sets of residuals; and combine (470) the sets of residuals with the first output video to generate a reconstructed output video (448). Each frame is divided into a plurality of tiles and each tile is divided into a plurality of blocks. To decode respective frames, the decoder is configured to obtain (440, 446) a preliminary set of residuals from the one or more further encoded streams, derive a set of temporal predictions using a temporal buffer (432), and combine (468) the set of temporal predictions with the preliminary set of residuals. The decoder is configured to provide for zeroing of values of the set of temporal predictions at a frame level, at a tile level and at a block level.