Signaling 360-Degree Video Information in Syntax Structures

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current video coding technologies face challenges in signaling 360-degree video information in a compatible manner with non-360-degree video information, requiring distinct encoding and decoding processes that differ from traditional video standards.

Innovation Solution

The implementation of a syntax structure that includes specific syntax elements for signaling 360-degree video, allowing for the coexistence and processing of both 360-degree and non-360-degree video data within the same bitstream, using mechanisms like Sequence Parameter Set (SPS) extensions to indicate 360-degree video and signal necessary projection information.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If separate encoding and decoding processes are used for 360-degree video and non-360-degree video, then 360-degree video can be processed with specialized techniques, but device complexity and processing overhead increase

Engineering Contradiction:
Improveprocessing accuracyVSAvoidencoding complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent combines 360-degree video syntax elements with non-360-degree video syntax elements into a unified syntax structure. The sequence parameter set includes both general video coding parameters and 360-degree specific parameters (such as projection type indicators) within the same data structure, allowing a single encoding/decoding process to handle both video types without requiring separate processing paths.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The syntax structure is designed to be universal, supporting both 360-degree and non-360-degree video through optional syntax elements. The same sequence parameter set structure can represent conventional video when 360-degree specific elements are absent or set to default values, and can represent 360-degree video when those elements are present, making the decoder universal without requiring separate processing paths.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Adaptability or versatility

If 360-degree video information is signaled using existing syntax structures, then compatibility with non-360-degree video is improved, but information loss occurs due to lack of dedicated syntax elements

Engineering Contradiction:
ImprovecompatibilityVSAvoidinformation completeness
Core Design Contradiction:
Adaptability or versatilityVSLoss of information

Solution Approach 1:

The patent embeds 360-degree video specific syntax elements within the existing sequence parameter set structure used for non-360-degree video. The 360-degree information (such as projection type flags and parameters) is nested as optional fields within the standard video coding syntax, allowing the structure to function as both a conventional video parameter set and a 360-degree video parameter set without creating separate signaling paths.

Inventive Principle:
Principle #7Nested doll (Nesting)

3Loss of information

If dedicated syntax structures are created for 360-degree video, then information completeness is improved, but compatibility with non-360-degree video processing decreases

Engineering Contradiction:
Improveinformation completenessVSAvoidcompatibility
Core Design Contradiction:
Loss of informationVSAdaptability or versatility

Solution Approach 1:

The syntax structure is designed to be universal, supporting both 360-degree and non-360-degree video through optional syntax elements. The same sequence parameter set structure can represent conventional video when 360-degree specific elements are absent or set to default values, and can represent 360-degree video when those elements are present, making the decoder universal without requiring separate processing paths.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS10779006B2Signaling 360-degree video information
Publication Date: 2020.09.15 QUALCOMM INC
  • US10779006B2 patent drawing
  • US10779006B2 patent drawing
  • US10779006B2 patent drawing

AI summary

This disclosure describes techniques for signaling 360-degree video information in syntax structures. As one example, this disclosure describes examples for signaling projection types and related information for 360-degree video in syntax structures that include one or more syntax elements. In some examples, the same syntax structures may include non-360-degree video information as well. Accordingly, the syntax structure may be used for encoding and decoding a bitstream carrying only non-360-degree video data, only 360-degree video data, or both non-360-degree video data and 360-degree video data.