Reference Picture List Configurable for Video Coding Efficiency

Solution Overview

Problem

In scalable or multiview video coding, existing technologies lack the flexibility to select inter-layer prediction information from reference layers other than the implicit reference layer, which can limit coding efficiency and lead to negative consequences when certain reference layer pictures are not available.

Innovation Solution

The introduction of additional syntax elements in the video bitstream allows for explicit selection of inter-layer prediction information from non-implicit reference layers, enabling the encoder to choose from multiple reference layers for enhanced coding efficiency, particularly in scenarios where the implicit reference layer is not coded at full frame rate.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If implicit reference layer prediction is used, then the reference picture list is minimized, but the flexibility to select reference layers is reduced

Engineering Contradiction:

Improveflexibility to select reference layersVSAvoidreference picture list complexity

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent applies dynamics by making the reference picture list configurable rather than fixed. The encoder can dynamically adjust the reference picture list based on coding conditions, allowing flexible selection of reference layers while maintaining the ability to minimize complexity when needed. This resolves the contradiction by enabling adaptive behavior rather than fixed functionality.

Inventive Principle:

Principle #15Dynamics

Solution Approach 2:

The patent changes the parameter of reference picture list composition from a fixed implicit structure to a configurable structure where the list can be modified based on coding conditions. This allows the system to adapt between using minimal implicit references and explicit multi-layer references, resolving the contradiction between flexibility and complexity.

Inventive Principle:

Principle #35Parameter changes

2Productivity

If explicit inter-layer prediction from multiple reference layers is enabled, then coding efficiency is improved, but the bitstream syntax complexity increases

Engineering Contradiction:

Improvecoding efficiencyVSAvoidsyntax structure complexity

Core Design Contradiction:

ProductivityVSDevice complexity

Solution Approach 1:

The patent segments the reference picture list into different components (temporal reference pictures and spatial reference pictures) that can be independently configured. This segmentation allows the syntax to remain organized and manageable while enabling flexible selection of reference layers, thus improving coding efficiency without proportionally increasing syntax complexity.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent creates a universal reference picture list structure that can serve multiple functions: it can contain implicit references, explicit references from multiple layers, and configurable combinations thereof. This multi-functionality allows the same syntax structure to support both simple and complex prediction scenarios, improving coding efficiency without requiring entirely new syntax for each case.

Inventive Principle:

Principle #6Universality (Multi-functionality)

3Productivity

If reference layer selection is restricted to implicit reference layer, then implementation complexity is reduced, but coding efficiency is limited

Engineering Contradiction:

Improvecoding efficiencyVSAvoidimplementation complexity

Core Design Contradiction:

ProductivityVSEase of manufacture

Solution Approach 1:

The patent applies dynamics by making the reference picture list configurable rather than fixed. The encoder can dynamically adjust the reference picture list based on coding conditions, allowing flexible selection of reference layers while maintaining the ability to minimize complexity when needed. This resolves the contradiction by enabling adaptive behavior rather than fixed functionality.

Inventive Principle:

Principle #15Dynamics

Solution Approach 2:

The patent changes the parameter of reference picture list composition from a fixed implicit structure to a configurable structure where the list can be modified based on coding conditions. This allows the system to adapt between using minimal implicit references and explicit multi-layer references, resolving the contradiction between flexibility and complexity.

Inventive Principle:

Principle #35Parameter changes

Data Source

PatentUS9078004B2Multiple reference layer prediction signaling techniques

Publication Date: 2015.07.07 VIDYO INC

AI summary

The disclosed subject matter, in one embodiment, provides techniques to signal inter-layer texture and motion prediction from different direct dependent reference layers. In certain exemplary arrangements, techniques are provided which include one or more syntax elements in a high level syntax structure, e.g., the slice segment header, indicating such different direct dependent reference layer(s).