Subpicture Reference Picture Lists for Motion Compensation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image encoding/decoding technologies face challenges in efficiently handling high-resolution and high-definition images, particularly in configuring reference picture lists for motion compensation when the location of reference subpictures differs from the target subpictures, and managing the number of activated reference indexes.

Innovation Solution

The method involves determining a reference picture list and override for the number of activated reference indexes in the slice header, even when specific Network Abstraction Layer (NAL) unit types are not present, using bitstream information to manage these configurations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If reference picture lists are configured for motion compensation when reference subpicture location differs from target subpicture location, then motion compensation accuracy is improved, but device complexity increases

Engineering Contradiction:
Improvemotion compensation accuracyVSAvoidreference picture list configuration complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The picture is divided into multiple subpictures, each with its own reference picture list configuration. This segmentation allows independent optimization of reference picture selection for different spatial regions, improving motion compensation accuracy without requiring complex global configuration. The slice header contains subpicture information that enables this segmented approach.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The reference picture list is dynamically configured based on the relative locations of target and reference subpictures. The system adapts the reference picture list configuration according to the specific spatial relationship between subpictures, rather than using a fixed configuration. This dynamic adaptation improves motion compensation accuracy while managing complexity through context-based configuration.

Inventive Principle:
Principle #15Dynamics

2Adaptability or versatility

If the number of activated reference indexes is overridden in the slice header, then encoding flexibility is improved, but bitstream complexity increases

Engineering Contradiction:
Improveencoding flexibilityVSAvoidbitstream structure complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The override of activated reference indexes is applied locally at the slice header level rather than globally. This allows different slices to have different numbers of activated reference indexes based on their specific content requirements. The first information in the slice header enables this localized control, providing encoding flexibility without requiring complex global bitstream structure changes.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The number of activated reference indexes is predetermined and signaled in the slice header before actual encoding proceeds. This preliminary configuration allows the encoder to optimize reference picture usage for each slice based on pre-analyzed characteristics, improving encoding flexibility while maintaining a relatively simple bitstream structure through advance parameter specification.

Inventive Principle:
Principle #10Preliminary action

3Measurement precision

If reference picture list determination is performed in slice header for non-specific NAL unit types, then decoding accuracy is improved, but processing time increases

Engineering Contradiction:
Improvedecoding accuracyVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The reference picture list is determined and configured in the slice header during the parsing phase, before actual decoding operations commence. This preliminary determination allows the decoder to have reference picture lists ready in advance, improving decoding accuracy through proper reference picture selection while minimizing processing time during the actual decoding by avoiding runtime calculations.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The slice header structure is designed to self-contain the necessary reference picture list determination information for non-specific NAL unit types. This self-service approach allows the decoder to extract and configure reference picture lists directly from the slice header without requiring additional complex processing or external information, improving both accuracy and processing efficiency.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS20250343894A1Method, apparatus and storage medium for image encoding/decoding using subpicture
Publication Date: 2025.11.06 ELECTRONICS & TELECOMM RES INST
  • US20250343894A1 patent drawing
  • US20250343894A1 patent drawing
  • US20250343894A1 patent drawing

AI summary

Disclosed herein are a method, an apparatus and a storage medium for performing encoding/decoding on an image using a subpicture. A picture may be partitioned into various units such as subpictures and slices, and various syntax elements and structures may be used to specify the units. In an embodiment, there is a method for configuring a reference picture list for motion compensation in the case where the location of a reference subpicture to be referred to for motion compensation is different from the location of a target subpicture. Further, in an embodiment, there is provided a method for providing the configuration of a reference picture list and an override on the number of activated reference indexes.