Subpicture Signaling in Video Coding Syntax Elements

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Video decoders face challenges in determining how to handle and extract subpictures from original pictures, leading to potential erroneous decoding and a poor user experience due to inadequate signaling of syntax elements in existing video coding standards.

Innovation Solution

The proposed solution involves determining and signaling syntax elements, such as the number of subpictures and their identification, within sequence parameter sets (SPS), picture parameter sets (PPS), and slice headers, allowing video decoders to correctly parse and handle subpictures, thereby improving subpicture extraction and decoding processes.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If subpicture signaling is not provided in video coding standards, then video coding complexity is reduced, but video decoder reliability deteriorates because decoders cannot determine how to identify and handle subpictures

Engineering Contradiction:
Improvevideo decoder reliabilityVSAvoidvideo coding complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent applies preliminary action by defining subpicture signaling syntax elements in advance within the video coding standard structure. Sequence parameter sets, picture parameter sets, and slice headers are pre-configured with subpicture identification syntax elements, enabling decoders to reliably identify and handle subpictures before actual decoding occurs, thus improving decoder reliability without adding runtime complexity

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If subpicture identification syntax elements are added to video coding standards, then subpicture extraction accuracy is improved, but information transmission overhead increases

Engineering Contradiction:
Improvesubpicture identification accuracyVSAvoidbitstream overhead
Core Design Contradiction:
Measurement precisionVSLoss of information

Solution Approach 1:

The patent applies local quality by strategically placing subpicture identification syntax elements only in specific locations within the bitstream structure—namely in sequence parameter sets, picture parameter sets, and slice headers—rather than uniformly throughout. This localized approach provides precise subpicture identification where needed while minimizing overall information overhead in the bitstream

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS11716488B2Subpicture signaling in high-level syntax for video coding
Publication Date: 2023.08.01 QUALCOMM INC
  • US11716488B2 patent drawing
  • US11716488B2 patent drawing
  • US11716488B2 patent drawing

AI summary

An example device includes a memory and one or more processors implemented in circuitry and communicatively coupled to the memory. The one or more processors are configured to determine a value of a first syntax element indicative of a number of subpictures in a picture of video data. The one or more processors are configured to determine, for each subpicture among the subpictures in the picture, a value of a respective second syntax element indicative of an identification of a respective subpicture. The one or more processors are also configured to code the respective subpicture identified by the respective second syntax element.