Reference Picture Management with ILRP Flags for Layered Coding

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video coding systems struggle to manage reference pictures effectively when employing inter-layer prediction, leading to inefficiencies in processor, memory, and network resource usage.

Innovation Solution

Implementing a mechanism for managing reference picture lists by using an inter-layer reference picture flag and layer indicator to distinguish between inter-prediction and inter-layer prediction, allowing decoders and encoders to select the correct reference pictures for inter-layer prediction.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Quantity of substance

If video data is compressed to reduce size for streaming and storage, then network bandwidth and memory resources are saved, but compression and decompression complexity increases

Engineering Contradiction:
Improvevideo data sizeVSAvoidcompression and decompression complexity
Core Design Contradiction:
Quantity of substanceVSDevice complexity

Solution Approach 1:

The video data is segmented into multiple layers (base layer and enhancement layers) with different quality levels. The base layer contains essential information for low-quality reproduction, while enhancement layers add additional detail. This segmentation allows flexible transmission and processing, reducing the complexity of handling large video datasets by processing them in manageable layers.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system performs preliminary classification and organization of reference pictures into different layers before actual decoding. By pre-organizing reference pictures in a layered structure with associated metadata, the decompression device can efficiently select and process only the necessary layers, reducing real-time processing complexity.

Inventive Principle:
Principle #10Preliminary action

2Productivity

If reference picture management is simplified, then processor and memory usage are reduced, but coding efficiency deteriorates

Engineering Contradiction:
Improvecoding efficiencyVSAvoidreference picture management complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

Different reference pictures are assigned different qualities and importances based on their layer and usage characteristics. The system maintains detailed metadata for inter-layer reference pictures while using simpler management for intra-layer references. This localized differentiation of management quality allows efficient coding where needed while reducing overall complexity.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The system introduces an intermediary reference picture list structure that mediates between the complex task of managing multiple reference pictures and the need for efficient processing. This intermediary structure organizes reference pictures by layer and type, providing a structured approach that improves coding efficiency without proportionally increasing processor and memory requirements.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Productivity

If inter-layer prediction is enabled to improve compression ratio, then coding efficiency increases, but reference picture list management complexity increases

Engineering Contradiction:
Improvecompression ratioVSAvoidreference picture list management complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The system adds a new dimension to reference picture management by introducing layer information as an additional attribute. Reference pictures are no longer just identified by their spatial and temporal position, but also by their layer membership. This dimensional expansion allows the system to efficiently manage inter-layer references through structured metadata, improving compression ratio while keeping management complexity可控.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

4Manufacturing precision

If more reference pictures are maintained for better prediction accuracy, then image quality improves, but memory resource usage increases

Engineering Contradiction:
Improveprediction accuracyVSAvoidmemory resource usage
Core Design Contradiction:
Manufacturing precisionVSQuantity of substance

Solution Approach 1:

The system extracts and separates inter-layer reference pictures from the general reference picture pool. By identifying and isolating these specific reference pictures through the inter-layer reference picture flag and associated metadata, the system can manage them differently - potentially removing them from the main reference buffer or processing them separately. This extraction allows maintaining prediction accuracy for inter-layer predictions while reducing overall memory requirements.

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentUS12464118B2Reference picture management in layered video coding
Publication Date: 2025.11.04 HUAWEI TECH CO LTD
  • US12464118B2 patent drawing
  • US12464118B2 patent drawing
  • US12464118B2 patent drawing

AI summary

A video coding mechanism is disclosed. The mechanism includes receiving a bitstream comprising a current picture and a reference picture list structure comprising an inter-layer reference picture flag. The mechanism determines an entry in the reference picture list structure associated with the current picture is an inter-layer reference picture (ILRP) entry based on the inter-layer reference picture flag. The current picture is decoded based on an inter-layer reference picture indicated by the entry in the reference picture list structure when the entry is the ILRP entry. The current picture is forwarded for display as part of a decoded video sequence.