Temporal Sublayer Signaling for Scalable VVC Decoder Compatibility
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Most HEVC decoders do not support scalability layers, limiting their use in applications requiring scalability, and the uptake of VVC profiles is uncertain, suggesting similar limited support for scalability layers.
Innovation Solution
Utilize temporal sublayers as scalability layers, incorporating sublayer referencing information, output sublayer set information, picture size, multiview, auxiliary, and quality information per temporal sublayer, and enable scalability through reference picture resampling in VVC.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If scalability layers are implemented in video coding profiles, then scalability functionality is provided, but decoder compatibility and support are limited
Solution Approach 1:
The patent uses temporal sublayer information as an intermediary mechanism to enable scalability functionality without requiring direct support for scalability layers in the decoder. The temporal sublayer ID and related parameters act as mediators that allow the system to achieve scalability effects while maintaining compatibility with existing decoders that only understand temporal sublayer concepts.
Solution Approach 2:
The patent changes the approach from using scalability layer IDs to using temporal sublayer ID parameters to convey scalability information. By reinterpreting temporal sublayer parameters to carry scalability semantics, the system enables scalability functionality through parameter transformation rather than requiring new decoder capabilities.
2Productivity
If VVC profiles are adopted to improve scalability support, then coding efficiency increases, but implementation uptake and compatibility remain limited
Solution Approach 1:
The patent makes temporal sublayer information serve multiple functions: it continues to provide temporal prediction functionality while simultaneously carrying scalability layer identification information. This multi-functionality allows existing temporal sublayer infrastructure to enable scalability without requiring separate dedicated scalability signaling mechanisms.
Solution Approach 2:
The patent creates a copy of the scalability layer identification function using temporal sublayer parameters. Instead of directly representing scalability layers, the system uses temporal sublayer ID values as a copy or representation that conveys the same scalability information, thereby avoiding the need for direct scalability layer support.
3Adaptability or versatility
If temporal sublayer information is added to bitstream, then scalability is enabled without scalability layer support, but bitstream complexity increases
Solution Approach 1:
The patent merges scalability information with temporal sublayer information that already exists in the bitstream. Instead of adding separate scalability layer signaling, the system combines scalability identification into the temporal sublayer ID and related parameters, thereby enabling scalability functionality without proportionally increasing bitstream complexity.
Solution Approach 2:
The patent makes existing temporal sublayer parameters serve dual purposes: temporal prediction and scalability indication. By making these parameters universal, the system avoids adding new bitstream elements for scalability, thereby limiting the increase in bitstream complexity while still enabling scalability functionality.
Data Source
AI summary
A method for determining one or more temporal sublayer properties from a bitstream is provided. The method includes determining, from the bitstream, a number N of temporal sublayers for which one or more temporal sublayer properties are specified. The method includes for each temporal sublayer of the N temporal sublayers having one or more temporal sublayer property values, decoding the one or more temporal sublayer property values from the bitstream wherein the one or more temporal sublayer property values includes one or more of: sublayer referencing information; output sublayer set information; picture width and picture height per temporal sublayer information; sublayer multiview information; sublayer auxiliary information; and/or sublayer quality information.