VVC Subpicture Track Decoding Order Flag

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

The VVC video file format faces issues in efficiently carrying and reconstructing subpictures across multiple tracks, particularly in ensuring subpictures are motion-constrained, contiguous in decoding order, and correctly ordered within a bitstream, which is crucial for 360° video streaming and other advanced applications.

Innovation Solution

The proposed solution involves modifying the VVC video file format to require subpicture tracks to cover rectangular areas, ensuring subpictures are motion-constrained and contiguous in decoding order, and allowing for flexible ordering of subpictures within a track, with specific flags and configurations to manage decoding order and merging of subpicture tracks.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If subpicture tracks store coded information for multiple subpictures in a flexible order, then adaptability and versatility are improved, but decoding complexity increases

Engineering Contradiction:

Improveflexible ordering of subpicturesVSAvoiddecoding complexity

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent applies preliminary action by introducing a decoding order flag that pre-specifies the intended decoding sequence. This flag is set during encoding to indicate whether subpictures should be decoded in track order or in a specific picture order, allowing the decoder to prepare the correct processing sequence in advance without complex runtime decisions

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The patent uses an intermediary mechanism (the decoding order flag and associated metadata) to mediate between the flexible track structure and the decoding process. This intermediary element carries the necessary ordering information from the encoding stage to the decoding stage, enabling flexible subpicture arrangement while maintaining straightforward decoding logic

Inventive Principle:

Principle #24Intermediary (Mediator)

2Manufacturing precision

If subpicture tracks are required to cover rectangular areas with motion constraints, then manufacturing precision is improved, but adaptability decreases

Engineering Contradiction:

Improvesubpicture positioning accuracyVSAvoidsubpicture track flexibility

Core Design Contradiction:

Manufacturing precisionVSAdaptability or versatility

Solution Approach 1:

The patent applies local quality by allowing different track types with different properties. Base tracks follow strict rectangular area requirements for precision, while subpicture tracks can operate in either strict rectangular mode or flexible mode depending on the decoding order flag, enabling localized adaptation of constraints to specific application needs

Inventive Principle:

Principle #3Local quality

Solution Approach 2:

The patent introduces dynamics by making the rectangular area constraint conditional rather than absolute. The decoding order flag enables the system to dynamically switch between strict rectangular geometry (when flag is set) and flexible geometry (when flag is not set), allowing the same track structure to adapt to different precision requirements

Inventive Principle:

Principle #15Dynamics

3Productivity

If multiple subpicture tracks are merged to reconstruct video units, then productivity is improved, but device complexity increases

Engineering Contradiction:

Improvevideo reconstruction efficiencyVSAvoidtrack merging complexity

Core Design Contradiction:

ProductivityVSDevice complexity

Solution Approach 1:

The patent applies preliminary action by pre-organizing subpicture tracks and base tracks with explicit references and ordering information during encoding. The decoding order flag and track reference structures are established in advance, allowing the decoder to efficiently merge tracks by simply following the pre-specified order without complex runtime analysis

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The patent uses segmentation by dividing the video content into separate base tracks and subpicture tracks that can be processed independently. Each track is self-contained with explicit references to others, allowing parallel processing and efficient merging by concatenating segments in the order specified by the decoding flag

Inventive Principle:

Principle #1Segmentation

Data Source

PatentUS12133019B2Subpicture track referencing and processing

Publication Date: 2024.10.29 LEMON INC(GB)

AI summary

Systems, methods and apparatus for processing visual media data are described. One example method includes performing a conversion between visual media data and a visual media file that includes one or more tracks that store one or more bitstreams of the visual media data according to a format rule; wherein the visual media file includes a base track that references one or more subpicture tracks that store coded information for one or more subpictures of the visual media data, and wherein the format rule specifies a process used to reconstruct a video unit from a sample in the base track and the one or more subpicture tracks.