Sub-Picture Layout Signaling in SPS for Efficient Video Decoding

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing video coding systems face inefficiencies in managing sub-pictures, leading to redundant signaling of layout information, increased resource usage, and potential errors due to lost packets, particularly in region of interest (ROI) applications and sub-picture based access schemes.

Innovation Solution

Incorporating sub-picture layout information into the Sequence Parameter Set (SPS) instead of the Picture Parameter Set (PPS), along with features like sub-picture IDs and flags for temporal motion constrained sub-pictures, to ensure layout signaling occurs only once per sequence or segment, reducing resource usage and error likelihood.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If sub-picture layout information is included in the Picture Parameter Set (PPS), then sub-picture based access schemes can be supported, but layout information is redundantly signaled for each picture increasing resource usage

Engineering Contradiction:

Improvesub-picture based access scheme supportVSAvoidbitstream size

Core Design Contradiction:

Adaptability or versatilityVSQuantity of substance

Solution Approach 1:

The patent extracts sub-picture layout information from the Picture Parameter Set (PPS) and places it in the Sequence Parameter Set (SPS) instead. This separation allows the layout information to be signaled once at the sequence level rather than repeated in every picture, reducing bitstream redundancy while maintaining sub-picture access functionality

Inventive Principle:

Principle #2Taking out (Extraction)

Solution Approach 2:

By placing sub-picture layout information in the SPS, the same parameter set serves multiple purposes: it provides sequence-level configuration and simultaneously enables sub-picture based access schemes. This multi-functional approach eliminates the need for separate signaling mechanisms

Inventive Principle:

Principle #6Universality (Multi-functionality)

2Productivity

If sub-picture layout information is signaled for each picture, then each picture can be independently decoded, but network resources, memory resources, and processing resources are increased

Engineering Contradiction:

Improveindependent picture decodingVSAvoiddecoder resource consumption

Core Design Contradiction:

ProductivityVSUse of energy by moving object

Solution Approach 1:

The patent performs preliminary action by signaling sub-picture layout information once in the SPS before picture decoding begins. This upfront configuration eliminates the need for repeated signaling in each picture, reducing decoder resource consumption while maintaining independent decoding capability

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

Instead of copying sub-picture layout information to every picture parameter set, the patent uses a single reference copy in the SPS that all pictures reference. This eliminates redundant data transmission and processing while preserving the ability to decode any picture independently

Inventive Principle:

Principle #26Copying

3Quantity of substance

If sub-picture information is derived by the decoder, then bitstream size is reduced, but errors occur in case of lost packets

Engineering Contradiction:

Improvebitstream sizeVSAvoiddecoding accuracy

Core Design Contradiction:

Quantity of substanceVSReliability

Solution Approach 1:

The patent provides beforehand cushioning by explicitly signaling sub-picture layout information in the SPS rather than relying on decoder derivation. This explicit signaling acts as a protective measure against packet loss, ensuring that critical layout information is reliably transmitted and can be recovered even if other data is lost

Inventive Principle:

Principle #11Beforehand cushioning (Prior cushioning)

Data Source

PatentUS12563215B2Sub-picture layout signaling in video coding

Publication Date: 2026.02.24 HUAWEI TECH CO LTD

AI summary

A video coding mechanism is disclosed. The mechanism includes receiving a bitstream comprising a sub-picture partitioned from a picture and a sequence parameter set (SPS) comprising a sub-picture size and a sub-picture location. The SPS is parsed to obtain the sub-picture size of the sub-picture and the sub-picture location of the sub-picture. The sub-picture is decoded based on the sub-picture size and the sub-picture location to create a video sequence. The video sequence is forwarded for display.