Inter-Layer Prediction Signaling for Scalable Video Decoding

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing video coding technologies face challenges in efficiently supporting scalability through inter-layer prediction, particularly in terms of resampling and resolution changes, leading to increased complexity and overhead in signaling processes.

Innovation Solution

The implementation of Reference Picture Resampling (RPR) and Adaptive Resolution Change (ARC) mechanisms in video bitstreams, utilizing inter-layer prediction to enhance coding efficiency by modifying high-level syntax elements, allowing block-level resampling without additional processes, and employing syntax elements like VPS to manage layer dependencies.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If inter-layer prediction with resampling is implemented in video coding, then coding efficiency is improved, but device complexity increases due to additional resampling processes and syntax element signaling

Engineering Contradiction:

Improvecoding efficiencyVSAvoiddevice complexity

Core Design Contradiction:

ProductivityVSDevice complexity

Solution Approach 1:

The patent merges the resampling process with the inter-layer prediction process by performing resampling during motion compensation. Instead of implementing separate resampling operations, the resampling is integrated into the existing motion compensation framework, allowing reference pictures to be resampled to different resolutions while being used for prediction. This integration eliminates the need for additional standalone resampling processes and reduces overall system complexity.

Inventive Principle:

Principle #5Merging (Combining)

Solution Approach 2:

The patent enables the motion compensation module to serve multiple functions: it performs both standard motion compensation and resampling operations. By making the motion compensation process universal, it can handle both integer-pixel and sub-integer-pixel precision requirements, and can operate with different picture resolutions without requiring separate dedicated resampling hardware or software modules.

Inventive Principle:

Principle #6Universality (Multi-functionality)

2Adaptability or versatility

If block-level resampling is performed during inter-layer prediction, then scalability is enhanced, but the number of processing steps increases

Engineering Contradiction:

ImprovescalabilityVSAvoidprocessing steps

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent combines block-level resampling with the motion compensation process. During inter-layer prediction, when reference pictures need to be resampled to match the resolution of the current picture, the resampling is performed as part of the motion compensation operation. This merging allows scalability to be achieved without adding separate resampling steps to the processing pipeline.

Inventive Principle:

Principle #5Merging (Combining)

3Adaptability or versatility

If additional syntax elements are added to signal inter-layer prediction parameters, then coding flexibility is improved, but bitstream overhead increases

Engineering Contradiction:

Improvecoding flexibilityVSAvoidbitstream overhead

Core Design Contradiction:

Adaptability or versatilityVSQuantity of substance

Solution Approach 1:

The patent implements conditional signaling of syntax elements based on whether inter-layer prediction is actually used. The syntax elements for inter-layer prediction parameters are only present in the bitstream when needed, rather than being continuously signaled. This partial action approach provides coding flexibility when required while minimizing bitstream overhead when the feature is not utilized.

Inventive Principle:

Principle #16Partial or excessive action

4Adaptability or versatility

If reference pictures are resampled to different resolutions, then support for multiple resolutions is improved, but processing time increases

Engineering Contradiction:

Improveresolution supportVSAvoidprocessing time

Core Design Contradiction:

Adaptability or versatilityVSLoss of time

Solution Approach 1:

The patent merges resampling operations with the existing motion compensation and picture decoding processes. By performing resampling during these already-necessary operations rather than as separate steps, the patent achieves support for multiple resolutions without adding significant processing time. The resampling utilizes the same computational resources and processing pipelines that are already engaged in decoding and motion compensation.

Inventive Principle:

Principle #5Merging (Combining)

Data Source

PatentUS20250386030A1Signaling of inter layer prediction in video bitstream

Publication Date: 2025.12.18 TENCENT AMERICA LLC

AI summary

An example method of video decoding includes receiving a scalable bitstream including a first layer and determining whether the first layer is a dependent layer of the scalable bitstream based at least in part on a syntax element from the scalable bitstream. When the first layer is the dependent layer, a picture in the dependent layer is decoded based on an inter-layer reference picture (ILRP) list, wherein a size of the ILRP corresponds to a number of direct reference layers indicated in the scalable bitstream. When the first layer is not the dependent layer, the picture in the first layer is decoded without using the ILRP list.