2D Spatial Relationship Specification for 3D Video Tile Delivery

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video coding techniques fail to efficiently process and deliver 3D spherical content, leading to high computational and bandwidth requirements, as they often transmit the entire sphere regardless of the user's viewport, resulting in suboptimal user experience due to limited network resources.

Innovation Solution

The method involves specifying 2D spatial relationships using a 2D Cartesian coordinate system to determine the spatial relationship of tracks within a track group, allowing for viewport-dependent processing and efficient delivery of only the content relevant to the user's current viewport, by generating source data based on constraints such as track positions, dimensions, and layer values within the 2D region.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If the entire spherical content is processed and delivered, then the user can view content at any viewport, but the computational and bandwidth requirements become excessively high

Engineering Contradiction:
Improveviewport flexibilityVSAvoidcomputational and bandwidth consumption
Core Design Contradiction:
Adaptability or versatilityVSLoss of energy

Solution Approach 1:

The spherical content is divided into multiple 2D regions or tiles that can be independently processed and delivered. Each region corresponds to a specific viewport area, allowing the system to selectively transmit only the necessary segments rather than the entire spherical content, thereby reducing bandwidth and computational requirements while maintaining viewport flexibility

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system dynamically determines which 2D regions to deliver based on the user's current viewport. By adapting the delivered content to match the actual viewing area in real-time, the system maintains full viewport flexibility while minimizing the amount of data that needs to be processed and transmitted

Inventive Principle:
Principle #15Dynamics

2Loss of energy

If viewport-dependent processing is implemented to reduce bandwidth, then network efficiency improves, but the system complexity increases

Engineering Contradiction:
Improvebandwidth consumptionVSAvoidprocessing system complexity
Core Design Contradiction:
Loss of energyVSDevice complexity

Solution Approach 1:

The patent introduces a 2D Cartesian coordinate system to represent spatial relationships on the spherical surface. This dimensional transformation allows complex 3D spherical coordinates to be simplified into 2D region definitions, making viewport-dependent processing more manageable and reducing system complexity while maintaining bandwidth efficiency

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Productivity

If 2D spatial relationships are specified using Cartesian coordinates, then the delivery efficiency improves, but the precision in representing spherical geometry may be compromised

Engineering Contradiction:
Improvecontent delivery efficiencyVSAvoidspherical geometry representation accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The spherical surface is segmented into multiple small 2D regions that can be accurately represented using Cartesian coordinates. By dividing the sphere into manageable tiles, each with limited spatial extent, the approximation error introduced by using 2D Cartesian geometry is minimized while still achieving efficient content delivery

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system changes the coordinate representation parameters by using 2D Cartesian coordinates for each regional tile rather than global spherical coordinates. This parameter change simplifies the mathematical operations required for content delivery while maintaining sufficient geometric accuracy through appropriate region sizing and segmentation

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS11146802B2Methods and apparatus for providing two-dimensional spatial relationships
Publication Date: 2021.10.12 MEDIATEK SINGAPORE PTE LTD
  • US11146802B2 patent drawing
  • US11146802B2 patent drawing
  • US11146802B2 patent drawing

AI summary

The techniques described herein relate to methods, apparatus, and computer readable media configured to specify two-dimensional spatial relationship information. Video data includes a track group type for a group of two-dimensional tracks. The track group type is a two-dimensional spatial relationship track group type, wherein a spatial relationship of the group of tracks is specified based on a two-dimensional Cartesian coordinate system. Two-dimensional spatial relationship description data for the group of tracks, can specify a two-dimensional region based on the two-dimensional Cartesian coordinate system, and a relation of each two-dimensional track in the group of two-dimensional tracks to the two-dimensional region. Source data for the two-dimensional region can be generated by composing each two-dimensional track from the group of tracks based on the associated relation of the two-dimensional track to the two-dimensional region.