Temporal Sublayer Signaling for Scalable Video Coding

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Most HEVC decoders do not support scalability layers, limiting their use in applications requiring scalability, and the uptake of VVC profiles is uncertain, suggesting similar limited support for scalability layers.

Innovation Solution

Utilize temporal sublayers as scalability layers, incorporating sublayer referencing information, output sublayer set information, picture width and height, multiview, auxiliary, and quality information per temporal sublayer into the bitstream to enable scalability in profiles that do not support traditional scalability layers.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If traditional scalability layers are used, then scalability functionality is achieved, but decoder compatibility is reduced because most HEVC decoders do not support scalability layers

Engineering Contradiction:
Improvescalability functionalityVSAvoiddecoder compatibility
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent uses temporal sublayers as an intermediary mechanism to achieve scalability functionality. Instead of implementing traditional scalability layers that require specialized decoder support, the invention maps scalability information onto the existing temporal sublayer structure that is universally supported by HEVC and VVC decoders. This intermediary approach allows scalability to be conveyed through temporal sublayer parameters (such as different temporal IDs representing different quality levels) without requiring decoders to understand native scalability layer syntax.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If VVC profiles are adopted, then improved video coding efficiency is achieved, but uncertainty remains about uptake and support for scalability layers

Engineering Contradiction:
Improvevideo coding efficiencyVSAvoidscalability layer support
Core Design Contradiction:
ProductivityVSAdaptability or versatility

Solution Approach 1:

The patent applies universality by making the temporal sublayer structure serve multiple functions: it maintains temporal prediction functionality as defined in the HEVC/VVC standards while simultaneously carrying scalability information. By encoding scalability-related data (such as quality differences, resolution variations, or view information) within the temporal sublayer framework, the same universal decoder infrastructure can handle both temporal prediction and scalability without requiring separate scalability layer support.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Adaptability or versatility

If scalability layers are implemented, then scalability applications are enabled, but loss of information occurs when decoders cannot process scalability layer data

Engineering Contradiction:
Improvescalability application supportVSAvoidscalability information loss
Core Design Contradiction:
Adaptability or versatilityVSLoss of information

Solution Approach 1:

The patent creates a copy or representation of scalability information within the temporal sublayer framework. Instead of relying on decoders to natively understand and process scalability layer data structures, the invention encodes scalability information in a format that mirrors temporal sublayer syntax. This copying approach ensures that scalability information is preserved and can be decoded by any standard-compliant HEVC/VVC decoder, eliminating information loss that would occur with proprietary scalability layer implementations.

Inventive Principle:
Principle #26Copying

Data Source

PatentUS12389009B2Temporal sublayer information for video coding
Publication Date: 2025.08.12 TELEFONAKTIEBOLAGET LM ERICSSON (PUBL)
  • US12389009B2 patent drawing
  • US12389009B2 patent drawing
  • US12389009B2 patent drawing

AI summary

A method for determining one or more temporal sublayer properties from a bitstream is provided. The method includes determining, from the bitstream, a number N of temporal sublayers for which one or more temporal sublayer properties are specified. The method includes for each temporal sublayer of the N temporal sublayers having one or more temporal sublayer property values, decoding the one or more temporal sublayer property values from the bitstream wherein the one or more temporal sublayer property values includes one or more of: sublayer referencing information; output sublayer set information; picture width and picture height per temporal sublayer information; sublayer multiview information; sublayer auxiliary information; and/or sublayer quality information.