Immersive Media Encapsulation via Region Description Box

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing immersive media technologies face limitations in encapsulating sub-picture frames of different resolutions within the same track group, leading to difficulties in indicating consumption relationships and flexibility in content playback, particularly in viewing angle adaptive transmission scenarios.

Innovation Solution

The solution involves encapsulating segmented videos of various resolutions within the same track group using an independently coded region description box, which includes coordinate information to identify the coordinate system of each segmented video, allowing for more flexible and accurate presentation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If sub-picture frames of different resolutions are encapsulated in different track groups, then the resolution consistency within each track group is maintained, but the encapsulation flexibility and ability to indicate consumption relationships between different resolution versions is limited

Engineering Contradiction:
Improveencapsulation flexibilityVSAvoidtrack group management complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent merges sub-picture frames of different resolutions into the same track group by introducing a new description box structure. This description box contains region information that identifies the spatial location and resolution characteristics of each sub-picture frame, allowing the playback device to distinguish and process different resolution versions within a unified track group structure.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent introduces an intermediary description box as a mediator between the track group and sub-picture frames. This description box contains region information that acts as an intermediate layer, enabling the system to manage diverse resolution content within a single track group while maintaining the ability to indicate consumption relationships between different resolution versions.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Loss of information

If high-definition and low-definition segmented videos are encapsulated to different track groups, then the resolution differentiation is clear, but the indication of consumption relationship between track groups becomes difficult

Engineering Contradiction:
Improveconsumption relationship informationVSAvoidtrack group structure
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent combines multiple resolution versions into a single track group using a unified description box structure. The region information within the description box identifies the consumption relationship between different resolution versions, eliminating the need for separate track groups while preserving the ability to indicate which versions can be consumed together.

Inventive Principle:
Principle #5Merging (Combining)

3Ease of operation

If sub-picture frames are partitioned by resolution into separate track groups, then the resolution consistency is ensured, but the convenience of content playback device operation is reduced

Engineering Contradiction:
Improvecontent playback convenienceVSAvoidtrack group management
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent merges sub-picture frames of different resolutions into a single track group with a unified description box. This structure allows the playback device to operate more conveniently by managing all resolution versions through one track group while the region information automatically provides the necessary resolution differentiation and consumption relationship indication.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS12010402B2Data processing for immersive media
Publication Date: 2024.06.11 TENCENT TECHNOLOGY (SHENZHEN) CO LTD
  • US12010402B2 patent drawing
  • US12010402B2 patent drawing
  • US12010402B2 patent drawing

AI summary

In a data processing method for an immersive media, independently coded region description information of an independently coded region of the immersive media is acquired. The independently coded region corresponds to a segmented video of a plurality of segmented videos encapsulated in tracks of a same track group. The independently coded region description information includes an independently coded region information and coordinate information. The coordinate information includes coordinate system identification information that indicates a coordinate system of the independently coded region. Further, the segmented video of the immersive media is displayed according to the independently coded region description information. Apparatus and non-transitory computer-readable storage medium counterpart embodiments are also contemplated.