Temporal Signalling for Tile-Based Scalable Video Coding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video coding systems face challenges in efficiently processing scalable encoding, particularly in terms of encoder and decoder efficiency, which affects the performance and adaptability to varying decoder capabilities and bandwidth conditions.
Innovation Solution
A hybrid backward-compatible coding format that combines a base codec with two enhancement levels, utilizing down-sampled and up-sampled signals to create a base and enhancement stream, allowing for flexible and adaptable video coding suitable for various use cases, including OTT transmission and live UHD broadcast.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If scalable encoding techniques are used to reconstruct signals at different quality levels, then adaptability to varying decoder capabilities and bandwidth conditions is improved, but encoder and decoder processing efficiency deteriorates
Solution Approach 1:
The video signal is segmented into a base layer and enhancement layers. The base layer contains essential information for basic reconstruction, while enhancement layers contain additional details for improved quality. This segmentation allows decoders to process only the base layer if resources are limited, or add enhancement layers progressively if capabilities permit, thus improving adaptability without proportionally increasing processing complexity.
Solution Approach 2:
The encoding system dynamically adapts the reconstruction quality by selectively transmitting and processing enhancement layers based on available bandwidth and decoder capabilities. The base layer provides a guaranteed minimum quality, while enhancement layers are added dynamically when conditions permit, enabling flexible adaptation to varying network and device conditions.
2Adaptability or versatility
If scalable encoding techniques are used to reconstruct signals at different quality levels, then adaptability to varying bandwidth conditions is improved, but decoder processing efficiency deteriorates
Solution Approach 1:
The bitstream is segmented into a base layer that can be decoded independently and enhancement layers that build upon it. This segmentation enables the decoder to process only the essential base layer when bandwidth or processing power is limited, while optionally adding enhancement layers when resources are abundant, thus improving bandwidth adaptability without forcing proportional increases in processing complexity.
Solution Approach 2:
The decoder performs partial processing by selectively decoding only the base layer when resources are constrained, or performing excessive processing by decoding all layers including enhancements when resources are abundant. This partial/excessive action approach allows the system to adapt processing effort to available resources rather than requiring full processing capability in all cases.
3Manufacturing precision
If a hybrid backward-compatible coding format combining base codec with enhancement levels is used, then visual quality is improved, but device complexity increases
Solution Approach 1:
The video coding system is segmented into a base codec that ensures backward compatibility and basic quality, and enhancement layers that provide additional visual quality improvements. This segmentation allows simple decoders to use only the base codec without needing to understand complex enhancement structures, while advanced decoders can process all layers for superior quality, thus improving visual quality without proportionally increasing complexity for all devices.
Solution Approach 2:
The base codec serves multiple functions: it provides backward compatibility with existing decoders, ensures basic acceptable quality, and forms the foundation for enhanced quality when enhancement layers are added. This multi-functionality of the base layer reduces overall system complexity by eliminating the need for separate legacy systems while maintaining universal compatibility.
Data Source
AI summary
An encoder configured to receive an input video comprising respective frames, each frame being divided into a plurality of tiles and each tile being divided into a plurality of blocks. The encoder is configured to generate a base encoded stream using a base encoder determine a temporal mode for one or more further encoded enhancement streams generated using an enhancement encoder and generate the one or more further encoded enhancement streams according to the determined temporal mode. The temporal mode is either a first temporal mode that does not apply non-zero values from a temporal buffer or a second temporal mode that does apply non-zero values from the temporal buffer. Generating the one or more further encoded enhancement streams comprises applying a transform to each of a series of blocks. The temporal mode is determined for one or more of a frame, tile or block.