Temporal Sublayer Signaling for Scalable Video Coding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Most HEVC decoders do not support scalability layers, limiting their use in applications requiring scalability, and the uptake of VVC profiles is uncertain, suggesting similar limited support for scalability layers.
Innovation Solution
Utilize temporal sublayers as scalability layers, incorporating sublayer referencing information, output sublayer set information, picture width and height, multiview, auxiliary, and quality information per temporal sublayer into the bitstream to enable scalability in profiles that do not support traditional scalability layers.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If traditional scalability layers are used, then scalability functionality is achieved, but decoder compatibility is reduced because most HEVC decoders do not support scalability layers
Solution Approach 1:
The patent uses temporal sublayers as an intermediary mechanism to achieve scalability functionality. Instead of implementing traditional scalability layers that require specialized decoder support, the invention maps scalability information onto the existing temporal sublayer structure that is universally supported by HEVC and VVC decoders. This intermediary approach allows scalability to be conveyed through temporal sublayer parameters (such as different temporal IDs representing different quality levels) without requiring decoders to understand native scalability layer syntax.
2Productivity
If VVC profiles are adopted, then improved video coding efficiency is achieved, but uncertainty remains about uptake and support for scalability layers
Solution Approach 1:
The patent applies universality by making the temporal sublayer structure serve multiple functions: it maintains temporal prediction functionality as defined in the HEVC/VVC standards while simultaneously carrying scalability information. By encoding scalability-related data (such as quality differences, resolution variations, or view information) within the temporal sublayer framework, the same universal decoder infrastructure can handle both temporal prediction and scalability without requiring separate scalability layer support.
3Adaptability or versatility
If scalability layers are implemented, then scalability applications are enabled, but loss of information occurs when decoders cannot process scalability layer data
Solution Approach 1:
The patent creates a copy or representation of scalability information within the temporal sublayer framework. Instead of relying on decoders to natively understand and process scalability layer data structures, the invention encodes scalability information in a format that mirrors temporal sublayer syntax. This copying approach ensures that scalability information is preserved and can be decoded by any standard-compliant HEVC/VVC decoder, eliminating information loss that would occur with proprietary scalability layer implementations.
Data Source
AI summary
A method for determining one or more temporal sublayer properties from a bitstream is provided. The method includes determining, from the bitstream, a number N of temporal sublayers for which one or more temporal sublayer properties are specified. The method includes for each temporal sublayer of the N temporal sublayers having one or more temporal sublayer property values, decoding the one or more temporal sublayer property values from the bitstream wherein the one or more temporal sublayer property values includes one or more of: sublayer referencing information; output sublayer set information; picture width and picture height per temporal sublayer information; sublayer multiview information; sublayer auxiliary information; and/or sublayer quality information.


