Motion-Constrained Tile Set Signaling for VR Bitstream Extraction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current video coding techniques, particularly in standards like ITU-T H.265, face inefficiencies in signaling and extraction of motion-constrained tile sets, which limits parallel processing and region-of-interest coding, and does not effectively allow bitstream extraction based on temporal sub-layers.

Innovation Solution

The method involves generating and transmitting a message with a replacement picture parameter set and a temporal identifier associated with it, enabling sub-bitstream extraction by specifying the temporal identifier, thus allowing for efficient extraction and processing of motion-constrained tile sets.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If current video coding techniques are used for motion-constrained tile set signaling, then video compression is achieved, but sub-bitstream extraction efficiency deteriorates

Engineering Contradiction:
Improvesub-bitstream extraction efficiencyVSAvoidsignaling complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent segments the bitstream into motion-constrained tile sets (MCTS) that can be independently extracted and processed. Each MCTS is signaled with specific parameters including temporal identifiers, allowing selective extraction of subsets of tiles based on spatial and temporal constraints without requiring full bitstream decoding

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent performs preliminary signaling of MCTS parameters including temporal identifiers and motion constraints during the encoding phase. This preliminary action prepares the bitstream structure in advance, enabling efficient sub-bitstream extraction at the receiving end without complex real-time analysis

Inventive Principle:
Principle #10Preliminary action

2Productivity

If motion-constrained tile sets are implemented, then parallel processing capability is improved, but signaling overhead increases

Engineering Contradiction:
Improveparallel processing capabilityVSAvoidsignaling overhead
Core Design Contradiction:
ProductivityVSQuantity of substance

Solution Approach 1:

The patent merges multiple signaling parameters into a unified MCTS structure that includes temporal identifiers, motion constraints, and tile set definitions in a single coherent framework. This merging reduces redundant signaling while maintaining all necessary information for parallel processing of multiple tile sets

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The MCTS signaling structure serves multiple functions simultaneously: it defines spatial tile boundaries, specifies temporal constraints for motion compensation, enables parallel processing paths, and facilitates sub-bitstream extraction. This multi-functionality reduces the need for separate signaling mechanisms

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Productivity

If temporal identifier-based extraction is implemented, then region-of-interest coding efficiency is improved, but message structure complexity increases

Engineering Contradiction:
Improveregion-of-interest coding efficiencyVSAvoidmessage structure complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent adds a temporal dimension to the extraction process by incorporating temporal identifiers into the MCTS signaling structure. This allows extraction not only by spatial region but also by temporal layer, enabling efficient region-of-interest coding across multiple temporal levels without requiring complex multi-dimensional indexing

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS11070845B2Systems and methods for signaling of motion-constrained tile sets for virtual reality applications
Publication Date: 2021.07.20 SHARP KK
  • US11070845B2 patent drawing
  • US11070845B2 patent drawing
  • US11070845B2 patent drawing

AI summary

A method of signaling a motion-constrained tile set is described. According to an aspect of an invention, a value specifying a temporal identifier associated with a replacement picture parameter set is included in SEI message.